Sep 16 01:15:11 devstack cinder-volume[75181]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75181) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 01:15:11 devstack cinder-volume[75181]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75181) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 01:15:11 devstack cinder-volume[75181]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75181) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 01:15:13 devstack cinder-volume[75181]: INFO dbcounter [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Registered counter for database cinder Sep 16 01:15:13 devstack cinder-volume[75181]: DEBUG oslo_db.sqlalchemy.engines [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:15:13 devstack cinder-volume[75181]: DEBUG dbcounter [-] [75181] Writer thread running {{(pid=75181) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 01:15:13 devstack cinder-volume[75181]: INFO cinder.rpc [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 01:15:13 devstack cinder-volume[75181]: INFO cinder.rpc [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 01:15:13 devstack cinder-volume[75181]: DEBUG oslo_db.sqlalchemy.engines [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:15:13 devstack cinder-volume[75181]: INFO cinder.volume.manager [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Determined volume DB was empty at startup. Sep 16 01:15:13 devstack cinder-volume[75181]: DEBUG cinder.volume.manager [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75181) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 16 01:15:13 devstack cinder-volume[75181]: INFO cinder.volume.manager [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 01:15:13 devstack cinder-volume[75181]: WARNING stevedore.named [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 01:15:13 devstack cinder-volume[75181]: WARNING castellan.key_manager [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 01:15:13 devstack cinder-volume[75181]: WARNING cinder.keymgr.conf_key_mgr [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 01:15:13 devstack cinder-volume[75181]: DEBUG cinder.volume.drivers.lvm [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75181) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Sep 16 01:15:13 devstack cinder-volume[75181]: DEBUG oslo_concurrency.processutils [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:14 devstack cinder-volume[75181]: DEBUG oslo_concurrency.processutils [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] CMD "cinder-rtstool verify" returned: 0 in 0.994s {{(pid=75181) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:14 devstack cinder-volume[75181]: DEBUG oslo_db.sqlalchemy.engines [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:15:14 devstack cinder-volume[75181]: INFO cinder.rpc [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 16 01:15:14 devstack cinder-volume[75181]: INFO cinder.rpc [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 16 01:15:14 devstack cinder-volume[75181]: WARNING stevedore.named [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 01:15:14 devstack cinder-volume[75181]: WARNING castellan.key_manager [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 01:15:14 devstack cinder-volume[75181]: INFO cinder.volume.manager [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 16 01:15:14 devstack cinder-volume[75181]: DEBUG oslo_db.sqlalchemy.engines [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75181) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:15:15 devstack cinder-volume[75181]: INFO oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Starting 1 workers Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Started child 75334 {{(pid=75181) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Full set of CONF: {{(pid=75181) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] ******************************************************************************** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Configuration options gathered from: {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] ================================================================================ {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] allow_availability_zone_fallback = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] allow_compression_on_image_upload = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] allowed_direct_url_schemes = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] api_rate_limit = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] auth_strategy = keystone {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] az_cache_duration = 3600 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_availability_zone = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_host = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_stats_polling_interval = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backup_api_class = cinder.backup.api.API {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backup_name_template = backup-%s {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backup_use_same_host = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backup_use_temp_snapshot = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] chap_password = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] chap_username = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_internal_tenant_project_id = a297e0c0bed349608270e0db9a97d237 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_internal_tenant_user_id = b2e75c7da8404b2fbefc5b61525f4756 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cloned_volume_same_az = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cluster = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] compression_format = gzip {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75334]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] compute_api_class = cinder.compute.nova.API {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] config_dir = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] config_source = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] control_exchange = openstack {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] debug = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] default_availability_zone = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] default_group_type = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] default_volume_type = lvmdriver-1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] driver_client_cert = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] driver_client_cert_key = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] driver_data_namespace = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] driver_ssl_cert_path = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] driver_ssl_cert_verify = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] driver_use_ssl = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] enable_force_upload = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] enable_new_services = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] enable_unsupported_driver = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] enabled_backends = ['lvmdriver-1'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] enforce_multipath_for_image_xfer = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] filter_function = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_api_insecure = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_api_ssl_compression = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_ca_certificates_file = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_catalog_info = image:glance:publicURL {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_certfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_keyfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_num_retries = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance_request_timeout = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] goodness_function = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] graceful_shutdown_timeout = 5 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] group_api_class = cinder.group.api.API {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] host = devstack {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_compress_on_upload = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_conversion_address_space_limit = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_conversion_cpu_limit = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_conversion_disable = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_upload_use_cinder_backend = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_upload_use_internal_tenant = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_volume_cache_enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_volume_cache_max_count = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] image_volume_cache_max_size_gb = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] init_host_max_objects_retrieval = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] instance_format = [instance: %(uuid)s] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] iscsi_iotype = fileio {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] iscsi_target_flags = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] iscsi_write_cache = on {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] iser_helper = tgtadm {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] iser_ip_address = 192.168.122.67 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] iser_port = 3260 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_color = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_config_append = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_dir = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_file = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_options = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_rotate_interval = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_rotate_interval_type = days {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] log_rotation_type = none {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] max_age = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] max_logfile_count = 30 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] max_logfile_size_mb = 200 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] max_over_subscription_ratio = 20.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] message_reap_interval = 86400 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] message_ttl = 2592000 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] migration_create_volume_timeout_secs = 300 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] monkey_patch = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] monkey_patch_modules = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] my_ip = 192.168.122.67 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] no_snapshot_gb_quota = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] num_iser_scan_tries = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] num_shell_tries = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] num_volume_device_scan_tries = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] nvmeof_conn_info_version = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] nvmet_ns_id = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] nvmet_port_id = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] osapi_max_limit = 1000 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] osapi_volume_ext_list = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] osapi_volume_listen = 0.0.0.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] osapi_volume_listen_port = 8776 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] osapi_volume_use_ssl = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] osapi_volume_workers = 2 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] per_volume_size_limit = -1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] periodic_fuzzy_delay = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] periodic_interval = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] project_id_regex = [0-9a-f\-]+ {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] public_endpoint = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] publish_errors = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] quota_backup_gigabytes = 1000 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] quota_backups = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] quota_gigabytes = 1000 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] quota_groups = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] quota_snapshots = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] quota_volumes = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] rate_limit_burst = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] rate_limit_except_level = CRITICAL {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] rate_limit_interval = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] reinit_driver_count = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] replication_device = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] report_discard_supported = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] report_interval = 120 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] reservation_clean_interval = 86400 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] reservation_expire = 86400 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] reserved_image_namespaces = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] reserved_percentage = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] rpc_response_timeout = 120 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] run_external_periodic_tasks = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] scst_target_driver = iscsi {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] scst_target_iqn_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_down_time = 720 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] shell_completion = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] snapshot_name_template = snapshot-%s {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] snapshot_same_host = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] split_loggers = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] state_path = /opt/stack/data/cinder {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] storage_availability_zone = nova {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] storage_protocol = iSCSI {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] syslog_log_facility = LOG_USER {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] target_helper = lioadm {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] target_ip_address = 192.168.122.67 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] target_port = 3260 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] target_protocol = iscsi {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] target_secondary_ip_addresses = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] trace_flags = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] transfer_api_class = cinder.transfer.api.API {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] transport_url = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] until_refresh = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] use_chap_auth = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] use_default_quota_class = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] use_journal = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] use_json = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] use_multipath_for_image_xfer = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] use_stderr = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] use_syslog = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] verify_glance_signatures = enabled {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_api_class = cinder.volume.api.API {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_backend_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_clear = zero {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_clear_ionice = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_clear_size = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_copy_bps_limit = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_dd_blocksize = 1M {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_name_template = volume-%s {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_service_inithost_offload = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volume_usage_audit_period = month {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] watch_log_file = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] zoning_mode = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_concurrency.disable_process_locking = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.admin_password = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.admin_token = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.admin_user = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.auth_admin_prefix = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.auth_port = 35357 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.auth_protocol = https {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.auth_section = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.auth_type = password {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.auth_uri = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.auth_version = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.cache = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.certfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.delay_auth_decision = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.http_connect_timeout = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.identity_uri = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.include_service_catalog = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.insecure = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.interface = public {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.keyfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_password = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcache_username = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.region_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.service_token_roles_required = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.service_type = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.token_cache_time = 300 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] keystone_authtoken.www_authenticate_uri = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.backend = dogpile.cache.null {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.backend_argument = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.backend_expiration_time = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.config_prefix = cache.oslo {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.dead_timeout = 60.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.debug_cache_backend = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.enable_retry_client = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.enable_socket_keepalive = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.enforce_fips_mode = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.expiration_time = 600 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.hashclient_retry_attempts = 2 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.hashclient_retry_delay = 1.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_dead_retry = 300 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_password = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_pool_maxsize = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_sasl_enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_socket_timeout = 1.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.memcache_username = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.proxies = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.redis_db = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.redis_password = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.redis_sentinel_service_name = mymaster {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.redis_server = localhost:6379 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.redis_socket_timeout = 1.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.redis_username = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.retry_attempts = 2 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.retry_delay = 0.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.socket_keepalive_count = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.socket_keepalive_idle = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.socket_keepalive_interval = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.tls_allowed_ciphers = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.tls_cafile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.tls_certfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.tls_enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cache.tls_keyfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] coordination.backend_url = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.asyncio_connection = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.asyncio_slave_connection = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.backend = sqlalchemy {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.connection = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.connection_debug = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.connection_parameters = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.connection_recycle_time = 3600 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.connection_trace = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.db_inc_retry_interval = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.db_max_retries = 20 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.db_max_retry_interval = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.db_retry_interval = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.max_overflow = 50 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.max_pool_size = 5 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.max_retries = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.mysql_wsrep_sync_wait = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.pool_timeout = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.retry_interval = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.slave_connection = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.sqlite_synchronous = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] database.use_db_reconnect = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.connection_string = messaging:// {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.es_doc_type = notification {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.es_scroll_size = 10000 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.es_scroll_time = 2m {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.filter_error_trace = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.hmac_keys = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.sentinel_service_name = mymaster {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.socket_timeout = 0.1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.trace_requests = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler.trace_sqlalchemy = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler_jaeger.process_tags = {} {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler_jaeger.service_name_prefix = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] profiler_otlp.service_name_prefix = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.enforce_new_defaults = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75334]: INFO cinder.volume.manager [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 16 01:15:15 devstack cinder-volume[75181]: WARNING oslo_config.cfg [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.enforce_scope = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.policy_default_rule = default {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.policy_file = policy.yaml {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_policy.remote_timeout = 60.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] privsep_osbrick.group = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] privsep_osbrick.helper_command = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] privsep_osbrick.thread_pool_size = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] privsep_osbrick.user = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_sys_admin.group = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_sys_admin.helper_command = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] cinder_sys_admin.user = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.auth_section = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.auth_type = password {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.certfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.collect_timing = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.insecure = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.keyfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.send_service_user_token = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.split_loggers = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] service_user.timeout = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.auth_section = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.auth_type = password {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.certfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.collect_timing = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.insecure = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.keyfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.split_loggers = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] glance.timeout = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.backend_availability_zone = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.chap_password = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.chap_username = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.driver_client_cert = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.driver_client_cert_key = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.driver_data_namespace = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.driver_use_ssl = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.enable_unsupported_driver = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.extra_capabilities = {} {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.filter_function = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.goodness_function = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.iscsi_iotype = fileio {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.iscsi_target_flags = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.iscsi_write_cache = on {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.iser_helper = tgtadm {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.iser_port = 3260 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.lvm_mirrors = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.lvm_share_target = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.lvm_type = auto {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.num_shell_tries = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.nvmet_port_id = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.replication_device = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.report_discard_supported = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.reserved_percentage = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.scst_target_driver = iscsi {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.scst_target_iqn_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.storage_protocol = iSCSI {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.target_helper = tgtadm {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.target_port = 3260 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.target_protocol = iscsi {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.trace_flags = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.unique_fqdn_network = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.use_chap_auth = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_backend_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_clear = zero {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_clear_ionice = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_clear_size = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volume_group = cinder-volumes {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_reports.file_event_handler = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_reports.log_dir = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.backend_availability_zone = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.backend_host = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.chap_password = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.chap_username = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.chiscsi_conf = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.driver_client_cert = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.driver_data_namespace = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.driver_use_ssl = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.extra_capabilities = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.filter_function = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.goodness_function = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.iscsi_iotype = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.iser_helper = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.iser_ip_address = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.iser_port = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.iser_target_prefix = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.lvm_conf_file = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.lvm_mirrors = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.lvm_share_target = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.lvm_type = auto {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.num_shell_tries = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.nvmet_port_id = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.replication_device = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.report_discard_supported = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.reserved_percentage = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.scst_target_driver = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.storage_protocol = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.target_helper = lioadm {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.target_ip_address = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.target_port = 3260 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.target_protocol = iscsi {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.trace_flags = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.use_chap_auth = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_clear = zero {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_clear_size = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] lvmdriver-1.volumes_dir = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.ssl = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.ssl_version = {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_notifications.driver = [] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_notifications.retry = -1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] key_manager.fixed_key = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.barbican_api_version = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.barbican_endpoint = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.barbican_endpoint_type = public {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.barbican_region_name = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.cafile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.certfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.collect_timing = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.insecure = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.keyfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.number_of_retries = 60 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.retry_delay = 1 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.send_service_user_token = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.split_loggers = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.timeout = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.verify_ssl = True {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican.verify_ssl_path = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.auth_section = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.auth_type = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.cafile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.certfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.collect_timing = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.insecure = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.keyfile = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.split_loggers = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] barbican_service_user.timeout = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.approle_role_id = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.approle_secret_id = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.kv_mountpoint = secret {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.kv_path = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.kv_version = 2 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.namespace = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.root_token_id = **** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.ssl_ca_crt_file = None {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.timeout = 60.0 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.use_ssl = False {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:15:15 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] ******************************************************************************** {{(pid=75181) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 16 01:15:15 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.203s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:15 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:15 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.105s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:16 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:16 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.110s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:16 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:16 devstack sudo[75390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 16 01:15:16 devstack sudo[75390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:18 devstack sudo[75390]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:18 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 1.891s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:18 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:18 devstack sudo[75502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:15:18 devstack sudo[75502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:19 devstack sudo[75502]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:19 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.907s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:19 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:15:19 devstack cinder-volume[75334]: INFO cinder.brick.local_dev.lvm [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 16 01:15:19 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:20 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.073s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:20 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:20 devstack sudo[75593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:15:20 devstack sudo[75593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:22 devstack sudo[75593]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:22 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.929s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:22 devstack cinder-volume[75334]: DEBUG cinder.brick.local_dev.lvm [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75334) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Sep 16 01:15:22 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:22 devstack sudo[75690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:15:22 devstack sudo[75690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:25 devstack cinder-volume[75181]: DEBUG dbcounter [-] [75181] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75181) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:15:25 devstack sudo[75690]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:25 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.531s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:25 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:25 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.115s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:25 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:25 devstack sudo[75884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:15:25 devstack sudo[75884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:27 devstack sudo[75884]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:27 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.913s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:27 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:27 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.102s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:27 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:27 devstack sudo[75921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 16 01:15:27 devstack sudo[75921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:29 devstack sudo[75921]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:29 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 1.992s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:29 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:30 devstack sudo[75952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:15:30 devstack sudo[75952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:32 devstack sudo[75952]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:32 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.964s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:32 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:33 devstack sudo[76015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:15:33 devstack sudo[76015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:35 devstack sudo[76015]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.528s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:35 devstack sudo[76020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:15:35 devstack sudo[76020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:38 devstack sudo[76020]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:38 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.746s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:38 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:38 devstack sudo[76025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:15:38 devstack sudo[76025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:40 devstack sudo[76025]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:40 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.116s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:40 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:40 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.126s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:40 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:40 devstack sudo[76036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:15:40 devstack sudo[76036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:42 devstack sudo[76036]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:42 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.423s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:42 devstack cinder-volume[75334]: INFO cinder.volume.drivers.lvm [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 16 01:15:42 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:43 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.085s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:43 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:43 devstack sudo[76151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:15:43 devstack sudo[76151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:45 devstack sudo[76151]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:45 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.952s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:45 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:15:45 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:45 devstack sudo[76243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:15:45 devstack sudo[76243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:47 devstack sudo[76243]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:47 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.342s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:47 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:47 devstack sudo[76328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:15:47 devstack sudo[76328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:49 devstack sudo[76328]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:49 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.896s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:49 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:49 devstack sudo[76331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:15:49 devstack sudo[76331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:51 devstack sudo[76331]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:51 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.864s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:51 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:51 devstack sudo[76337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:15:51 devstack sudo[76337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:53 devstack sudo[76337]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:53 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.891s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:53 devstack cinder-volume[75334]: INFO cinder.volume.driver [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 01:15:53 devstack cinder-volume[75334]: DEBUG cinder.volume.driver [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75334) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 16 01:15:53 devstack cinder-volume[75334]: DEBUG oslo_db.sqlalchemy.engines [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75334) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:15:53 devstack cinder-volume[75334]: DEBUG dbcounter [-] [75334] Writer thread running {{(pid=75334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 01:15:53 devstack cinder-volume[75334]: DEBUG cinder.db.sqlalchemy.api [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Building query based on filter {{(pid=75334) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 16 01:15:53 devstack cinder-volume[75334]: DEBUG cinder.image.image_utils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75334) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 16 01:15:53 devstack cinder-volume[75334]: INFO cinder.keymgr.migration [None req-09806969-2625-475c-a030-c4a591edfd38 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 01:15:53 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:15:53 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:53 devstack sudo[76343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:15:53 devstack sudo[76343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:55 devstack sudo[76343]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:55 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.902s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:55 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:55 devstack sudo[76443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:15:55 devstack sudo[76443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:57 devstack sudo[76443]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:57 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.012s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:57 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:57 devstack sudo[76489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:15:57 devstack sudo[76489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:15:59 devstack sudo[76489]: pam_unix(sudo:session): session closed for user root Sep 16 01:15:59 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.830s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:15:59 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:15:59 devstack sudo[76492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:15:59 devstack sudo[76492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:01 devstack sudo[76492]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:01 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.731s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:01 devstack cinder-volume[75334]: DEBUG cinder.manager [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Notifying Schedulers of capabilities ... {{(pid=75334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:16:01 devstack cinder-volume[75334]: INFO cinder.volume.manager [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Driver initialization completed successfully. Sep 16 01:16:01 devstack cinder-volume[75334]: INFO cinder.manager [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Initiating service 2 cleanup Sep 16 01:16:01 devstack cinder-volume[75334]: INFO cinder.manager [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Service 2 cleanup completed. Sep 16 01:16:01 devstack cinder-volume[75334]: DEBUG cinder.service [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Creating RPC server for service cinder-volume {{(pid=75334) start /opt/stack/cinder/cinder/service.py:239}} Sep 16 01:16:01 devstack cinder-volume[75334]: DEBUG cinder.service [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75334) start /opt/stack/cinder/cinder/service.py:245}} Sep 16 01:16:01 devstack cinder-volume[75334]: INFO cinder.volume.manager [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 16 01:16:01 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:16:01 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:16:01 devstack sudo[76496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:16:01 devstack sudo[76496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:03 devstack sudo[76496]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:03 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.966s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:03 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:16:03 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:16:03 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:05 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:05 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.924s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:05 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:16:05 devstack sudo[76507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:16:05 devstack sudo[76507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:07 devstack sudo[76507]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:07 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.405s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:07 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:16:08 devstack sudo[76515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:16:08 devstack sudo[76515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:09 devstack sudo[76515]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:09 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.773s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:09 devstack cinder-volume[75334]: INFO cinder.volume.manager [None req-a2fb3e8d-1b61-4e5b-ad3a-0342787ae217 None None] Driver post RPC initialization completed successfully. Sep 16 01:16:19 devstack cinder-volume[75334]: DEBUG dbcounter [-] [75334] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:16:19 devstack cinder-volume[75334]: DEBUG dbcounter [-] [75334] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=75334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:16:33 devstack cinder-volume[75334]: DEBUG oslo_service.periodic_task [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:16:33 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:16:33 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:16:34 devstack sudo[77272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:16:34 devstack sudo[77272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:35 devstack sudo[77272]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.914s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:16:35 devstack sudo[77340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:16:35 devstack sudo[77340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:37 devstack sudo[77340]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.932s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:16:37 devstack sudo[77400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:16:37 devstack sudo[77400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:39 devstack sudo[77400]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.986s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:16:39 devstack sudo[77462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:16:39 devstack sudo[77462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:16:41 devstack sudo[77462]: pam_unix(sudo:session): session closed for user root Sep 16 01:16:41 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.982s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:16:41 devstack cinder-volume[75334]: DEBUG cinder.manager [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Notifying Schedulers of capabilities ... {{(pid=75334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:17:33 devstack cinder-volume[75334]: DEBUG oslo_service.periodic_task [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:17:33 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:17:33 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:17:34 devstack sudo[77985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:17:34 devstack sudo[77985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:17:35 devstack sudo[77985]: pam_unix(sudo:session): session closed for user root Sep 16 01:17:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.975s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:17:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:17:36 devstack sudo[78099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:17:36 devstack sudo[78099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:17:37 devstack sudo[78099]: pam_unix(sudo:session): session closed for user root Sep 16 01:17:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.943s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:17:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:17:38 devstack sudo[78102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:17:38 devstack sudo[78102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:17:39 devstack sudo[78102]: pam_unix(sudo:session): session closed for user root Sep 16 01:17:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.899s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:17:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:17:39 devstack sudo[78105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:17:39 devstack sudo[78105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:17:41 devstack sudo[78105]: pam_unix(sudo:session): session closed for user root Sep 16 01:17:41 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.930s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:17:41 devstack cinder-volume[75334]: DEBUG cinder.manager [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Notifying Schedulers of capabilities ... {{(pid=75334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:18:20 devstack cinder-volume[75334]: DEBUG dbcounter [-] [75334] Writing DB stats cinder:SELECT=1 {{(pid=75334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:18:20 devstack cinder-volume[75334]: DEBUG dbcounter [-] [75334] Writing DB stats cinder:UPDATE=1 {{(pid=75334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:18:33 devstack cinder-volume[75334]: DEBUG oslo_service.periodic_task [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:18:33 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:18:33 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:18:34 devstack sudo[78908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:18:34 devstack sudo[78908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:18:35 devstack sudo[78908]: pam_unix(sudo:session): session closed for user root Sep 16 01:18:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.882s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:18:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:18:35 devstack sudo[78911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:18:35 devstack sudo[78911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:18:37 devstack sudo[78911]: pam_unix(sudo:session): session closed for user root Sep 16 01:18:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.818s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:18:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:18:37 devstack sudo[78932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:18:37 devstack sudo[78932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:18:39 devstack sudo[78932]: pam_unix(sudo:session): session closed for user root Sep 16 01:18:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.941s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:18:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:18:39 devstack sudo[79081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:18:39 devstack sudo[79081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:18:41 devstack sudo[79081]: pam_unix(sudo:session): session closed for user root Sep 16 01:18:41 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.932s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:18:41 devstack cinder-volume[75334]: DEBUG cinder.manager [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Notifying Schedulers of capabilities ... {{(pid=75334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:19:33 devstack cinder-volume[75334]: DEBUG oslo_service.periodic_task [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:19:33 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:19:33 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:19:34 devstack sudo[81453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:19:34 devstack sudo[81453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:19:35 devstack sudo[81453]: pam_unix(sudo:session): session closed for user root Sep 16 01:19:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.725s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:19:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:19:35 devstack sudo[81459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:19:35 devstack sudo[81459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:19:37 devstack sudo[81459]: pam_unix(sudo:session): session closed for user root Sep 16 01:19:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.930s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:19:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:19:37 devstack sudo[81470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:19:37 devstack sudo[81470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:19:39 devstack sudo[81470]: pam_unix(sudo:session): session closed for user root Sep 16 01:19:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.749s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:19:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:19:39 devstack sudo[81485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:19:39 devstack sudo[81485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:19:41 devstack sudo[81485]: pam_unix(sudo:session): session closed for user root Sep 16 01:19:41 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.714s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:19:41 devstack cinder-volume[75334]: DEBUG cinder.manager [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Notifying Schedulers of capabilities ... {{(pid=75334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:20:19 devstack cinder-volume[75334]: DEBUG dbcounter [-] [75334] Writing DB stats cinder:SELECT=1 {{(pid=75334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:20:20 devstack cinder-volume[75334]: DEBUG dbcounter [-] [75334] Writing DB stats cinder:UPDATE=1 {{(pid=75334) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:20:33 devstack cinder-volume[75334]: DEBUG oslo_service.periodic_task [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:20:33 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:20:33 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:20:34 devstack sudo[81734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:20:34 devstack sudo[81734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:20:35 devstack sudo[81734]: pam_unix(sudo:session): session closed for user root Sep 16 01:20:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.843s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:20:35 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:20:35 devstack sudo[81739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:20:35 devstack sudo[81739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:20:37 devstack sudo[81739]: pam_unix(sudo:session): session closed for user root Sep 16 01:20:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.977s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:20:37 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:20:37 devstack sudo[81746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:20:37 devstack sudo[81746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:20:39 devstack sudo[81746]: pam_unix(sudo:session): session closed for user root Sep 16 01:20:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.962s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:20:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:20:39 devstack sudo[81752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:20:39 devstack sudo[81752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:20:41 devstack sudo[81752]: pam_unix(sudo:session): session closed for user root Sep 16 01:20:41 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.904s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:20:41 devstack cinder-volume[75334]: DEBUG cinder.manager [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Notifying Schedulers of capabilities ... {{(pid=75334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:21:28 devstack cinder-volume[75181]: INFO oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Caught SIGTERM, stopping children Sep 16 01:21:28 devstack cinder-volume[75181]: DEBUG oslo_concurrency.lockutils [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Acquiring lock "singleton_lock" {{(pid=75181) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 01:21:28 devstack cinder-volume[75181]: DEBUG oslo_concurrency.lockutils [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Acquired lock "singleton_lock" {{(pid=75181) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 01:21:28 devstack cinder-volume[75181]: DEBUG oslo_concurrency.lockutils [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Releasing lock "singleton_lock" {{(pid=75181) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 01:21:28 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Stop services. {{(pid=75181) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}} Sep 16 01:21:28 devstack cinder-volume[75181]: DEBUG oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Killing children. {{(pid=75181) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}} Sep 16 01:21:28 devstack cinder-volume[75181]: INFO oslo_service.backend._eventlet.service [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Waiting on 1 children to exit Sep 16 01:21:33 devstack cinder-volume[75334]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 16 01:21:33 devstack cinder-volume[75334]: DEBUG oslo_service.periodic_task [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75334) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:21:33 devstack cinder-volume[75334]: DEBUG cinder.volume.drivers.lvm [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Updating volume stats {{(pid=75334) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}} Sep 16 01:21:33 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:21:34 devstack sudo[82717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 16 01:21:34 devstack sudo[82717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:21:39 devstack sudo[82717]: pam_unix(sudo:session): session closed for user root Sep 16 01:21:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 5.802s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:21:39 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:21:40 devstack sudo[82867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:21:40 devstack sudo[82867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:21:45 devstack sudo[82867]: pam_unix(sudo:session): session closed for user root Sep 16 01:21:45 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 6.050s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:21:45 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:21:46 devstack sudo[82880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 16 01:21:46 devstack sudo[82880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:21:52 devstack sudo[82880]: pam_unix(sudo:session): session closed for user root Sep 16 01:21:52 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 6.582s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:21:52 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:21:52 devstack sudo[82957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 16 01:21:52 devstack sudo[82957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:21:53 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 01:21:53 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 01:21:53 devstack cinder-volume[82714]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82714) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 01:21:58 devstack cinder-volume[82714]: INFO dbcounter [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Registered counter for database cinder Sep 16 01:21:58 devstack cinder-volume[82714]: DEBUG oslo_db.sqlalchemy.engines [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:21:59 devstack cinder-volume[82714]: DEBUG dbcounter [-] [82714] Writer thread running {{(pid=82714) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 01:21:59 devstack sudo[82957]: pam_unix(sudo:session): session closed for user root Sep 16 01:21:59 devstack cinder-volume[82714]: INFO cinder.rpc [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 16 01:21:59 devstack cinder-volume[82714]: INFO cinder.rpc [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 16 01:21:59 devstack cinder-volume[82714]: DEBUG oslo_db.sqlalchemy.engines [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:21:59 devstack cinder-volume[75334]: DEBUG oslo_concurrency.processutils [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 6.534s {{(pid=75334) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:21:59 devstack cinder-volume[75334]: DEBUG cinder.manager [None req-bd67eed7-f082-40aa-8c1e-8d4932e51284 None None] Notifying Schedulers of capabilities ... {{(pid=75334) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:21:59 devstack cinder-volume[75334]: DEBUG oslo_concurrency.lockutils [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Acquiring lock "singleton_lock" {{(pid=75334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} Sep 16 01:21:59 devstack cinder-volume[75334]: DEBUG oslo_concurrency.lockutils [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Acquired lock "singleton_lock" {{(pid=75334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} Sep 16 01:21:59 devstack cinder-volume[75334]: DEBUG oslo_concurrency.lockutils [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Releasing lock "singleton_lock" {{(pid=75334) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} Sep 16 01:21:59 devstack cinder-volume[75334]: WARNING amqp [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 01:21:59 devstack cinder-volume[82714]: INFO cinder.volume.manager [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Determined volume DB was empty at startup. Sep 16 01:21:59 devstack cinder-volume[82714]: DEBUG cinder.volume.manager [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82714) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Sep 16 01:21:59 devstack cinder-volume[75334]: WARNING amqp [None req-26610bc7-b94d-46d9-bcb9-72947903f84a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 16 01:21:59 devstack cinder-volume[82714]: INFO cinder.volume.manager [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 16 01:21:59 devstack cinder-volume[82714]: WARNING stevedore.named [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 16 01:21:59 devstack cinder-volume[82714]: WARNING castellan.key_manager [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 01:21:59 devstack cinder-volume[82714]: WARNING cinder.keymgr.conf_key_mgr [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 16 01:21:59 devstack cinder-volume[82714]: INFO cinder.volume.manager [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 16 01:21:59 devstack cinder-volume[82714]: DEBUG oslo_db.sqlalchemy.engines [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82714) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:21:59 devstack cinder-volume[82714]: INFO oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Starting 1 workers Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Started child 83041 {{(pid=82714) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Full set of CONF: {{(pid=82714) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] ******************************************************************************** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Configuration options gathered from: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] ================================================================================ {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] allow_availability_zone_fallback = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] allow_compression_on_image_upload = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] allowed_direct_url_schemes = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] api_rate_limit = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] auth_strategy = keystone {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_availability_zone = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_host = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_stats_polling_interval = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backup_api_class = cinder.backup.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backup_name_template = backup-%s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backup_use_same_host = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backup_use_temp_snapshot = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] chap_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] chap_username = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_internal_tenant_project_id = a297e0c0bed349608270e0db9a97d237 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_internal_tenant_user_id = b2e75c7da8404b2fbefc5b61525f4756 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cluster = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] compression_format = gzip {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] compute_api_class = cinder.compute.nova.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] config_dir = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] config_source = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] control_exchange = openstack {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] debug = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] default_availability_zone = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] default_group_type = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] default_volume_type = QuobyteHD {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] driver_client_cert = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] driver_client_cert_key = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] driver_data_namespace = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] driver_ssl_cert_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] driver_ssl_cert_verify = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] driver_use_ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] enable_new_services = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] enable_unsupported_driver = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] enabled_backends = ['QuobyteHD'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] enforce_multipath_for_image_xfer = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] filter_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_api_insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_api_servers = ['http://192.168.122.67/image'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_api_ssl_compression = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_ca_certificates_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_catalog_info = image:glance:publicURL {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_num_retries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[83041]: INFO cinder.service [-] Starting cinder-volume node (version 26.1.0) Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance_request_timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] goodness_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] graceful_shutdown_timeout = 5 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] group_api_class = cinder.group.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] host = devstack {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_compress_on_upload = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_conversion_address_space_limit = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_conversion_cpu_limit = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_conversion_disable = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_upload_use_cinder_backend = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_upload_use_internal_tenant = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_volume_cache_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_volume_cache_max_count = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] image_volume_cache_max_size_gb = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] init_host_max_objects_retrieval = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] instance_format = [instance: %(uuid)s] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] iscsi_iotype = fileio {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] iscsi_target_flags = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] iscsi_write_cache = on {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] iser_helper = tgtadm {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] iser_ip_address = 192.168.122.67 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] iser_port = 3260 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_color = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_config_append = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_dir = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_options = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_rotate_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_rotate_interval_type = days {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] log_rotation_type = none {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] max_age = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] max_logfile_count = 30 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] max_logfile_size_mb = 200 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] max_over_subscription_ratio = 20.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] message_reap_interval = 86400 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] message_ttl = 2592000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] migration_create_volume_timeout_secs = 300 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] monkey_patch = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] monkey_patch_modules = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] my_ip = 192.168.122.67 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] no_snapshot_gb_quota = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] num_iser_scan_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] num_shell_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] num_volume_device_scan_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] nvmeof_conn_info_version = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] nvmet_ns_id = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] nvmet_port_id = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] osapi_max_limit = 1000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] osapi_volume_ext_list = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] osapi_volume_listen_port = 8776 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] osapi_volume_use_ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] osapi_volume_workers = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] per_volume_size_limit = -1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] periodic_fuzzy_delay = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] periodic_interval = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] public_endpoint = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] publish_errors = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] quota_backup_gigabytes = 1000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] quota_backups = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] quota_gigabytes = 1000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] quota_groups = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] quota_snapshots = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] quota_volumes = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] rate_limit_burst = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] rate_limit_except_level = CRITICAL {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] rate_limit_interval = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] reinit_driver_count = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] replication_device = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] report_discard_supported = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] report_interval = 120 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] reservation_clean_interval = 86400 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] reservation_expire = 86400 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] reserved_image_namespaces = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] reserved_percentage = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] rpc_response_timeout = 120 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] run_external_periodic_tasks = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] scst_target_driver = iscsi {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] scst_target_iqn_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_down_time = 720 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] shell_completion = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] snapshot_name_template = snapshot-%s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] state_path = /opt/stack/data/cinder {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] storage_availability_zone = nova {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] storage_protocol = iSCSI {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] syslog_log_facility = LOG_USER {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] target_helper = lioadm {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] target_ip_address = 192.168.122.67 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] target_port = 3260 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] target_protocol = iscsi {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] target_secondary_ip_addresses = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] trace_flags = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] transport_url = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] until_refresh = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] use_chap_auth = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] use_default_quota_class = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] use_journal = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] use_json = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] use_multipath_for_image_xfer = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] use_stderr = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] use_syslog = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] verify_glance_signatures = enabled {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_api_class = cinder.volume.api.API {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_backend_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_clear = zero {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_clear_ionice = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_clear_size = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_copy_bps_limit = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_dd_blocksize = 1M {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_name_template = volume-%s {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_service_inithost_offload = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volume_usage_audit_period = month {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] watch_log_file = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] zoning_mode = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] os_brick.lock_path = /opt/stack/data/cinder {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_concurrency.disable_process_locking = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.admin_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.admin_token = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.admin_user = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.auth_port = 35357 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.auth_protocol = https {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.auth_section = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.auth_type = password {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.auth_uri = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.auth_version = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.cache = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.identity_uri = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.include_service_catalog = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.interface = public {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_password = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcache_username = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.region_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.service_type = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] keystone_authtoken.www_authenticate_uri = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.backend = dogpile.cache.null {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.backend_argument = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.backend_expiration_time = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.config_prefix = cache.oslo {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.dead_timeout = 60.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.debug_cache_backend = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.enable_retry_client = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.enable_socket_keepalive = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.enforce_fips_mode = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.expiration_time = 600 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.hashclient_retry_attempts = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.hashclient_retry_delay = 1.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_dead_retry = 300 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_pool_maxsize = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_sasl_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_socket_timeout = 1.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.memcache_username = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.proxies = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.redis_db = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.redis_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.redis_server = localhost:6379 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.redis_socket_timeout = 1.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.redis_username = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.retry_attempts = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.retry_delay = 0.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.socket_keepalive_count = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.socket_keepalive_idle = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.socket_keepalive_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.tls_allowed_ciphers = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.tls_cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.tls_certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.tls_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cache.tls_keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] coordination.backend_url = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.asyncio_connection = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.asyncio_slave_connection = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.backend = sqlalchemy {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.connection = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.connection_debug = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.connection_parameters = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.connection_recycle_time = 3600 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.connection_trace = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.db_inc_retry_interval = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.db_max_retries = 20 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.db_max_retry_interval = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.db_retry_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.max_overflow = 50 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.max_pool_size = 5 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.max_retries = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.mysql_wsrep_sync_wait = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.pool_timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.retry_interval = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.slave_connection = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.sqlite_synchronous = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] database.use_db_reconnect = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.connection_string = messaging:// {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.es_doc_type = notification {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.es_scroll_size = 10000 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.es_scroll_time = 2m {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.filter_error_trace = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.hmac_keys = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.sentinel_service_name = mymaster {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.socket_timeout = 0.1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.trace_requests = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler.trace_sqlalchemy = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler_jaeger.process_tags = {} {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler_jaeger.service_name_prefix = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] profiler_otlp.service_name_prefix = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.enforce_new_defaults = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: WARNING oslo_config.cfg [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.enforce_scope = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.policy_default_rule = default {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.policy_file = policy.yaml {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] privsep_osbrick.group = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] privsep_osbrick.helper_command = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] privsep_osbrick.logger_name = os_brick.privileged {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] privsep_osbrick.thread_pool_size = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] privsep_osbrick.user = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_sys_admin.group = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_sys_admin.helper_command = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] cinder_sys_admin.user = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.auth_section = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.auth_type = password {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.collect_timing = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.send_service_user_token = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] service_user.timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.auth_section = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.auth_type = password {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.collect_timing = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] glance.timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.backend_availability_zone = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.chap_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.chap_username = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.driver_client_cert = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.driver_client_cert_key = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.driver_data_namespace = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.driver_use_ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.extra_capabilities = {} {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.filter_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.goodness_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.iscsi_iotype = fileio {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.iscsi_target_flags = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.iscsi_write_cache = on {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.iser_helper = tgtadm {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.iser_ip_address = 192.168.122.67 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.iser_port = 3260 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_host = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_login = admin {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_mount_options = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_private_key = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_share_path = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.num_shell_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.quobyte_volume_url = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.replication_device = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.report_discard_supported = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.reserved_percentage = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.target_helper = tgtadm {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.target_ip_address = 192.168.122.67 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.target_port = 3260 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.target_protocol = iscsi {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.trace_flags = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.unique_fqdn_network = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.use_chap_auth = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volume_backend_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volume_clear = zero {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volume_clear_ionice = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volume_clear_size = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_reports.file_event_handler = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_reports.log_dir = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.backend_availability_zone = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.backend_host = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.chap_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.chap_username = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.chiscsi_conf = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.driver_client_cert = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.driver_data_namespace = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.driver_use_ssl = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.extra_capabilities = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.filter_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.goodness_function = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.iscsi_iotype = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.iser_helper = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.iser_ip_address = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.iser_port = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.iser_target_prefix = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_host = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_login = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_mount_options = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_password = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_private_key = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_secure_file_operations = true {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_share_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_ssh_port = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.num_shell_tries = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.nvmet_port_id = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:22:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Starting volume driver QuobyteDriver (1.1.13) Sep 16 01:22:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=83041) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.quobyte_volume_url = quobyte://10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.replication_device = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.report_discard_supported = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.reserved_percentage = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.scst_target_driver = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.storage_protocol = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.target_helper = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.target_ip_address = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.target_port = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.target_prefix = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.target_protocol = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.trace_flags = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.use_chap_auth = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volume_clear = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volume_clear_size = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] QuobyteHD.volumes_dir = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_notifications.driver = [] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_notifications.retry = -1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] key_manager.fixed_key = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.barbican_api_version = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.barbican_endpoint = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.barbican_endpoint_type = public {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.barbican_region_name = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.collect_timing = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.number_of_retries = 60 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.retry_delay = 1 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.send_service_user_token = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.verify_ssl = True {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican.verify_ssl_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.auth_section = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.auth_type = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.cafile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.certfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.collect_timing = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.insecure = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.keyfile = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.split_loggers = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] barbican_service_user.timeout = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.approle_role_id = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.approle_secret_id = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.kv_mountpoint = secret {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.kv_path = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.kv_version = 2 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.namespace = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.root_token_id = **** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.ssl_ca_crt_file = None {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.timeout = 60.0 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.use_ssl = False {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} Sep 16 01:22:00 devstack cinder-volume[82714]: DEBUG oslo_service.backend._eventlet.service [None req-5e4a1ded-924e-4d20-b091-e2710cdba786 None None] ******************************************************************************** {{(pid=82714) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} Sep 16 01:22:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=83041) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Sep 16 01:22:00 devstack cinder-volume[83041]: INFO cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual. Sep 16 01:22:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Running cmd (subprocess): mount.quobyte {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:22:01 devstack quobyte-client[83057]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 01:22:01 devstack quobyte-client[83057]: Invalid parameters found, error: missing mount point. Sep 16 01:22:01 devstack quobyte-client[83057]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 16 01:22:01 devstack quobyte-client[83057]: Failed to parse all commandline parameters, please use -h/--help to see available options. Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] CMD "mount.quobyte" returned: 1 in 0.266s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:22:01 devstack cinder-volume[83041]: INFO cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Mounting volume: 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 ... Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a -c /etc/quobyte/client-cinder.cfg {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:22:01 devstack quobyte-client[83064]: Reading configuration file: /etc/quobyte/client-cinder.cfg Sep 16 01:22:01 devstack quobyte-client[83064]: Reading configuration file: /etc/quobyte/client.cfg Sep 16 01:22:01 devstack quobyte-client[83064]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a' to display the log. Sep 16 01:22:01 devstack quobyte-client[83066]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic). Sep 16 01:22:01 devstack quobyte-client[83066]: mount.quobyte 3.25 (4fbbd59204) Sep 16 01:22:01 devstack quobyte-client[83066]: Client UUID: 977r6807-B4lU-wsyb-0asC-iAC2Soex4zBu Sep 16 01:22:01 devstack quobyte-client[83066]: Registry: osci01.corp.quobyte.com:7861 Sep 16 01:22:01 devstack quobyte-client[83066]: Volume: cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:22:01 devstack quobyte-client[83066]: FUSE version: 316 Sep 16 01:22:01 devstack quobyte-client[83066]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps) Sep 16 01:22:01 devstack quobyte-client[83066]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied Sep 16 01:22:01 devstack quobyte-client[83066]: Setting total object cache size to 3352297472 bytes Sep 16 01:22:01 devstack quobyte-client[83066]: Using FUSE low-level API Sep 16 01:22:01 devstack quobyte-client[83066]: Caching of uid/gid to user/group name mappings is enabled Sep 16 01:22:01 devstack quobyte-client[83066]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10 Sep 16 01:22:01 devstack quobyte-client[83066]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab. Sep 16 01:22:01 devstack quobyte-client[83066]: HTTP server started on port 55000 Sep 16 01:22:01 devstack quobyte-client[83066]: Caching mappings from uid/gid to user/group name and group membership temporarily. Sep 16 01:22:01 devstack quobyte-client[83066]: Mount point /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a established Sep 16 01:22:01 devstack quobyte-client[83066]: TimeSync is running and remote sync every 60 seconds Sep 16 01:22:01 devstack quobyte-client[83066]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 01:22:01 devstack quobyte-client[83066]: Ignored time synchronization message because time source took too long to respond (55 ms) Sep 16 01:22:01 devstack quobyte-client[83066]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 01:22:01 devstack quobyte-client[83066]: Opening volume cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 (1c20c07b-de8c-44e1-a98c-8b6cfb21abdd) Sep 16 01:22:01 devstack quobyte-client[83066]: Setting metadata cache size to 500000 based on available system memory of 16 GiB Sep 16 01:22:01 devstack quobyte-client[83066]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 01:22:01 devstack quobyte-client[83066]: Failed to invalidate inode: 38: Function not implemented Sep 16 01:22:01 devstack quobyte-client[83066]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 01:22:01 devstack quobyte-client[83066]: Automatic minidump upload enabled by global system configuration Sep 16 01:22:01 devstack quobyte-client[83066]: Announcing HTTP status server address 172.24.4.1 Sep 16 01:22:01 devstack quobyte-client[83066]: Registered as service (uuid 977r6807-B4lU-wsyb-0asC-iAC2Soex4zBu) Sep 16 01:22:01 devstack quobyte-client[83066]: Quobyte Client running as pid 83066 Sep 16 01:22:01 devstack quobyte-client[83066]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2 Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.724s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:22:01 devstack quobyte-client[83066]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl Sep 16 01:22:01 devstack cinder-volume[83041]: INFO cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Mounting volume: 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 succeeded Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.788s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:22:01 devstack quobyte-client[83066]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 01:22:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.079s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:22:02 devstack cinder-volume[83041]: INFO cinder.volume.driver [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Driver hasn't implemented _init_vendor_properties() Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.volume.driver [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83041) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_db.sqlalchemy.engines [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83041) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writer thread running {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.db.sqlalchemy.api [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Building query based on filter {{(pid=83041) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83041) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}} Sep 16 01:22:02 devstack cinder-volume[83041]: INFO cinder.keymgr.migration [None req-f0a88a04-bd18-4413-bc54-78effce5ba2b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.079s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:22:02 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Driver initialization completed successfully. Sep 16 01:22:02 devstack cinder-volume[83041]: INFO cinder.manager [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Initiating service 3 cleanup Sep 16 01:22:02 devstack cinder-volume[83041]: INFO cinder.manager [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Service 3 cleanup completed. Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.service [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Creating RPC server for service cinder-volume {{(pid=83041) start /opt/stack/cinder/cinder/service.py:239}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.service [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83041) start /opt/stack/cinder/cinder/service.py:245}} Sep 16 01:22:02 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13) Sep 16 01:22:02 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:22:02 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:22:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:22:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.089s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:22:03 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dedb4fed-c569-4a5b-8ff2-2ada807b2156 None None] Driver post RPC initialization completed successfully. Sep 16 01:22:04 devstack quobyte-client[83066]: Resolving 'registry:' with default 10.10.41.181:7861 Sep 16 01:22:09 devstack cinder-volume[82714]: DEBUG dbcounter [-] [82714] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82714) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:22:12 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:22:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:23:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:23:01 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:23:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Flow 'volume_create_manager' (c05e169f-60dc-4f1e-bdc6-318537b69dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:23:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1115c7d8-78e2-4c75-9e96-fbc87435bdd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1115c7d8-78e2-4c75-9e96-fbc87435bdd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-474815292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0db550-4e1d-4218-9eda-480653348c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb84af91f9349bb9e4afccf130aeee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:23:01Z,use_quota=True,user_id='5550d43ff8ac454ca0447a0267bc3d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d666bc61-2e83-46f1-ad9a-6cb614bf2d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d666bc61-2e83-46f1-ad9a-6cb614bf2d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38af661-e242-4811-85cb-cda811669c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b38af661-e242-4811-85cb-cda811669c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf0db550-4e1d-4218-9eda-480653348c86', 'volume_name': 'volume-cf0db550-4e1d-4218-9eda-480653348c86', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb1b623-12de-48a4-8d93-baf1c9881e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2eb1b623-12de-48a4-8d93-baf1c9881e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e021fd-01ca-46cf-8795-6802800b31cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:23:02 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Volume cf0db550-4e1d-4218-9eda-480653348c86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf0db550-4e1d-4218-9eda-480653348c86', 'volume_size': 1} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-474815292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf0db550-4e1d-4218-9eda-480653348c86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb84af91f9349bb9e4afccf130aeee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:23:01Z,use_quota=True,user_id='5550d43ff8ac454ca0447a0267bc3d27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Creating volume cf0db550-4e1d-4218-9eda-480653348c86 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:23:02 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:23:02 devstack quobyte-client[83066]: System call of process 83248 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:23:02 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=2, name=volume-cf0db550-4e1d-4218-9eda-480653348c86, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:23:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86 1073741824" returned: 0 in 0.823s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86" returned: 0 in 0.162s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] <== create_volume: return (1065ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52e021fd-01ca-46cf-8795-6802800b31cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf0db550-4e1d-4218-9eda-480653348c86', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1249d1e1-e065-4684-999f-a87496fcb961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.337s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:23:03 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Volume volume-cf0db550-4e1d-4218-9eda-480653348c86 (cf0db550-4e1d-4218-9eda-480653348c86): created successfully Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1249d1e1-e065-4684-999f-a87496fcb961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:23:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Flow 'volume_create_manager' (c05e169f-60dc-4f1e-bdc6-318537b69dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:23:03 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5e504d25-b751-4aa8-bbe6-3edec0112986 tempest-VolumesAssistedSnapshotsTest-923722077 None] Created volume successfully. Sep 16 01:23:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=2,cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:23:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:24:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:24:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:24:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:24:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:24:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:24:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:24:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:24:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 1.092s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:24:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:24:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:24:06 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:24:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Flow 'volume_create_manager' (7405953b-8594-4dd9-81d2-d3e3970dc326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a474d4-b122-47ee-ac6e-b2e028a911f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a474d4-b122-47ee-ac6e-b2e028a911f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-105420369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a81c8d4-65d1-4703-8378-9cf9417b35b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52be2ee42e43c2903d9824388b7154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:24:07Z,use_quota=True,user_id='1ddaece4c79d4df596c6f88a50b26ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9acb5c-1545-4006-bbd0-d2d5dadfc48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e9acb5c-1545-4006-bbd0-d2d5dadfc48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb9ad5d-ccb9-4945-ae0c-a4531cde4fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb9ad5d-ccb9-4945-ae0c-a4531cde4fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a81c8d4-65d1-4703-8378-9cf9417b35b6', 'volume_name': 'volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f031a74d-ee5d-445a-9fbb-18b9772d6d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f031a74d-ee5d-445a-9fbb-18b9772d6d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4373d734-6643-42c6-aea3-535ac1dbc176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:24:07 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Volume 2a81c8d4-65d1-4703-8378-9cf9417b35b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6', 'volume_size': 1} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-105420369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a81c8d4-65d1-4703-8378-9cf9417b35b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb52be2ee42e43c2903d9824388b7154',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:24:07Z,use_quota=True,user_id='1ddaece4c79d4df596c6f88a50b26ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Creating volume 2a81c8d4-65d1-4703-8378-9cf9417b35b6 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:24:07 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:24:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:24:07 devstack quobyte-client[83066]: System call of process 83956 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:24:07 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=3, name=volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:24:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6 1073741824" returned: 0 in 0.897s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:24:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:24:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6" returned: 0 in 0.165s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:24:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] <== create_volume: return (1186ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:24:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:24:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4373d734-6643-42c6-aea3-535ac1dbc176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:24:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621d17e7-d8ea-43e1-9f2e-96af118eec73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:24:09 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Volume volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6 (2a81c8d4-65d1-4703-8378-9cf9417b35b6): created successfully Sep 16 01:24:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621d17e7-d8ea-43e1-9f2e-96af118eec73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:24:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Flow 'volume_create_manager' (7405953b-8594-4dd9-81d2-d3e3970dc326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:24:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-18c9e275-1f45-4190-a0e5-e4d290193ee2 tempest-VolumesAdminNegativeTest-1657786639 None] Created volume successfully. Sep 16 01:24:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Acquiring lock "cinder-2a81c8d4-65d1-4703-8378-9cf9417b35b6-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:24:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "cinder-2a81c8d4-65d1-4703-8378-9cf9417b35b6-delete_volume" acquired by "delete_volume" :: waited 0.211s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:24:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:24:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Acquiring lock "cinder-quobyte-2a81c8d4-65d1-4703-8378-9cf9417b35b6" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:24:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "cinder-quobyte-2a81c8d4-65d1-4703-8378-9cf9417b35b6" acquired by "delete_volume" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:24:11 devstack cinder-volume[83041]: INFO oslo.privsep.daemon [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpdm7a_dbv/privsep.sock'] Sep 16 01:24:11 devstack sudo[83995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpdm7a_dbv/privsep.sock Sep 16 01:24:11 devstack sudo[83995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:24:21 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:24:21 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:24:25 devstack sudo[83995]: pam_unix(sudo:session): session closed for user root Sep 16 01:24:25 devstack cinder-volume[83041]: INFO oslo.privsep.daemon [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Spawned new privsep daemon via rootwrap Sep 16 01:24:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Accepted privsep connection to /tmp/tmpdm7a_dbv/privsep.sock {{(pid=83041) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}} Sep 16 01:24:25 devstack cinder-volume[83041]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 16 01:24:25 devstack cinder-volume[83041]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 16 01:24:25 devstack cinder-volume[83041]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 16 01:24:25 devstack cinder-volume[83041]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84046 Sep 16 01:24:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f97e9b-5ee6-42fa-ba1e-3fda19bb0819]: (2,) {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:24:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d47a138-3d8a-46fc-a493-2eb6be469c77]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:24:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:24:26 devstack quobyte-client[83066]: System call of process 84075 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:24:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6" returned: 0 in 0.906s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:24:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:24:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a81c8d4-65d1-4703-8378-9cf9417b35b6" returned: 0 in 0.198s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:24:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "cinder-quobyte-2a81c8d4-65d1-4703-8378-9cf9417b35b6" released by "delete_volume" :: held 15.328s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:24:27 devstack cinder-volume[83041]: WARNING cinder.quota [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:24:27 devstack cinder-volume[83041]: WARNING cinder.quota [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:24:27 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Created reservations ['432a235e-d8b8-4619-a88e-bf345274ebff', '35f511c4-7e71-4965-acb9-4dd2b7983ea3', '54215aef-0040-4daa-b8cf-35291e679dce', '09b09b60-67b8-488c-bced-708343ccdfe4'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:24:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:24:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:24:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:24:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:24:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:24:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:24:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.238s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:24:28 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:24:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Deleted volume successfully. Sep 16 01:24:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9e0be2aa-8590-407d-9a43-a2855078e903 tempest-VolumesAdminNegativeTest-1657786639 None] Lock "cinder-2a81c8d4-65d1-4703-8378-9cf9417b35b6-delete_volume" released by "delete_volume" :: held 17.942s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:24:38 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=5,cinder:INSERT=1,cinder:UPDATE=9 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:24:39 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=3,cinder:INSERT=3,cinder:UPDATE=6,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.143s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:25:03 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:25:17 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:25:17 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:25:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Flow 'volume_create_manager' (d06a8af7-bbe4-4294-83e5-42cea7808359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:25:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c36f60-9bba-437b-b2a0-a7e01d369a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c36f60-9bba-437b-b2a0-a7e01d369a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1769015893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3181cacc-5626-45c4-99a0-234069379603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6f2405e8194a2880e51484da0a9413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:25:17Z,use_quota=True,user_id='d2b844dc1ff24a339eaedeb9fc930929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7837a5-ff51-4485-b057-e5d0cf49f9cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d7837a5-ff51-4485-b057-e5d0cf49f9cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84bc4c6-5c05-4710-91d7-afd9a04c618f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84bc4c6-5c05-4710-91d7-afd9a04c618f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3181cacc-5626-45c4-99a0-234069379603', 'volume_name': 'volume-3181cacc-5626-45c4-99a0-234069379603', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3109add-90a1-4f9b-be61-a7fae1fabb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3109add-90a1-4f9b-be61-a7fae1fabb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6627aa3d-18ae-4191-a003-1f64484e6b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:18 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Volume 3181cacc-5626-45c4-99a0-234069379603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3181cacc-5626-45c4-99a0-234069379603', 'volume_size': 1} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1769015893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3181cacc-5626-45c4-99a0-234069379603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6f2405e8194a2880e51484da0a9413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:25:17Z,use_quota=True,user_id='d2b844dc1ff24a339eaedeb9fc930929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Creating volume 3181cacc-5626-45c4-99a0-234069379603 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:25:18 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:25:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:25:18 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=4, name=volume-3181cacc-5626-45c4-99a0-234069379603, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:25:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603 1073741824" returned: 0 in 1.190s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:25:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:25:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603" returned: 0 in 0.284s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:25:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] <== create_volume: return (1787ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:25:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:25:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6627aa3d-18ae-4191-a003-1f64484e6b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3181cacc-5626-45c4-99a0-234069379603', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70bf09bf-3f96-466d-8305-a70266f417f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:20 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Volume volume-3181cacc-5626-45c4-99a0-234069379603 (3181cacc-5626-45c4-99a0-234069379603): created successfully Sep 16 01:25:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70bf09bf-3f96-466d-8305-a70266f417f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Flow 'volume_create_manager' (d06a8af7-bbe4-4294-83e5-42cea7808359) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:25:21 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-fad303d4-7a9d-4409-8462-9e2921071e51 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Created volume successfully. Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6d7a8b48-2f36-444f-a2ae-327385a11360 req-851abba0-0cb1-4a7c-9098-d040cc6e9a67 tempest-VolumesAssistedSnapshotsTest-923722077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6d7a8b48-2f36-444f-a2ae-327385a11360 req-851abba0-0cb1-4a7c-9098-d040cc6e9a67 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fff2b7-b83b-411f-9a85-647c9d5f5a2b]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-6d7a8b48-2f36-444f-a2ae-327385a11360 req-851abba0-0cb1-4a7c-9098-d040cc6e9a67 tempest-VolumesAssistedSnapshotsTest-923722077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-2af267cf-3410-447e-b1b1-0ab4666a2be2 req-cbe8b7e6-4e09-4a6c-847c-08e29b20378a tempest-AttachSCSIVolumeTestJSON-1290406766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-6d7a8b48-2f36-444f-a2ae-327385a11360 req-851abba0-0cb1-4a7c-9098-d040cc6e9a67 tempest-VolumesAssistedSnapshotsTest-923722077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86" returned: 0 in 0.486s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6d7a8b48-2f36-444f-a2ae-327385a11360 req-851abba0-0cb1-4a7c-9098-d040cc6e9a67 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.528s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-2af267cf-3410-447e-b1b1-0ab4666a2be2 req-cbe8b7e6-4e09-4a6c-847c-08e29b20378a tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.364s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3e2e93-56fd-4976-9952-64e8d112d30f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:25:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-2af267cf-3410-447e-b1b1-0ab4666a2be2 req-cbe8b7e6-4e09-4a6c-847c-08e29b20378a tempest-AttachSCSIVolumeTestJSON-1290406766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:25:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-6d7a8b48-2f36-444f-a2ae-327385a11360 req-851abba0-0cb1-4a7c-9098-d040cc6e9a67 tempest-VolumesAssistedSnapshotsTest-923722077 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-cf0db550-4e1d-4218-9eda-480653348c86', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6af2e4e5-b680-412f-8698-11031e476f7a', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:25:31 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-6d7a8b48-2f36-444f-a2ae-327385a11360 req-851abba0-0cb1-4a7c-9098-d040cc6e9a67 tempest-VolumesAssistedSnapshotsTest-923722077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:25:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-2af267cf-3410-447e-b1b1-0ab4666a2be2 req-cbe8b7e6-4e09-4a6c-847c-08e29b20378a tempest-AttachSCSIVolumeTestJSON-1290406766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603" returned: 0 in 0.582s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:25:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-2af267cf-3410-447e-b1b1-0ab4666a2be2 req-cbe8b7e6-4e09-4a6c-847c-08e29b20378a tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.684s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:25:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-6d7a8b48-2f36-444f-a2ae-327385a11360 req-851abba0-0cb1-4a7c-9098-d040cc6e9a67 tempest-VolumesAssistedSnapshotsTest-923722077 None] attachment_update completed successfully. Sep 16 01:25:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-2af267cf-3410-447e-b1b1-0ab4666a2be2 req-cbe8b7e6-4e09-4a6c-847c-08e29b20378a tempest-AttachSCSIVolumeTestJSON-1290406766 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-3181cacc-5626-45c4-99a0-234069379603', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2c6fe254-a90f-4250-a4e1-209db0b163bd', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:25:31 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-2af267cf-3410-447e-b1b1-0ab4666a2be2 req-cbe8b7e6-4e09-4a6c-847c-08e29b20378a tempest-AttachSCSIVolumeTestJSON-1290406766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:25:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-2af267cf-3410-447e-b1b1-0ab4666a2be2 req-cbe8b7e6-4e09-4a6c-847c-08e29b20378a tempest-AttachSCSIVolumeTestJSON-1290406766 None] attachment_update completed successfully. Sep 16 01:25:41 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=10,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:25:41 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=6,cinder:SELECT=14 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:25:50 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Flow 'volume_create_manager' (cfa13960-4630-4217-83c3-28aed2b92422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec025f7-8fff-4884-82b5-adba92c952c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ec025f7-8fff-4884-82b5-adba92c952c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-884956098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b188c6-8e96-432b-8a35-094148e94d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3003127d5d5c493b809bc26878e09a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:25:51Z,use_quota=True,user_id='757a729b67904b47bae14f28589a2737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef06522-b6f0-4a51-bb75-c9848a15eee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef06522-b6f0-4a51-bb75-c9848a15eee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6d31a9-f1e9-4d29-915f-bbfc7f807bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b6d31a9-f1e9-4d29-915f-bbfc7f807bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b188c6-8e96-432b-8a35-094148e94d28', 'volume_name': 'volume-61b188c6-8e96-432b-8a35-094148e94d28', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b8f3ce-0ab7-4381-8e8c-f918436d7ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0b8f3ce-0ab7-4381-8e8c-f918436d7ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4790d7-6a98-43ae-952d-146e6c192a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:50 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Volume 61b188c6-8e96-432b-8a35-094148e94d28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b188c6-8e96-432b-8a35-094148e94d28', 'volume_size': 1} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:25:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-884956098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b188c6-8e96-432b-8a35-094148e94d28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3003127d5d5c493b809bc26878e09a1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:25:51Z,use_quota=True,user_id='757a729b67904b47bae14f28589a2737',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Creating volume 61b188c6-8e96-432b-8a35-094148e94d28 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:25:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:25:51 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:25:51 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=5, name=volume-61b188c6-8e96-432b-8a35-094148e94d28, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:25:51 devstack quobyte-client[83066]: System call of process 85055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28 1073741824" returned: 0 in 0.328s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28" returned: 0 in 0.079s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.489s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca4790d7-6a98-43ae-952d-146e6c192a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b188c6-8e96-432b-8a35-094148e94d28', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd914589-4854-4078-96c2-2f56d4d95c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:25:51 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Volume volume-61b188c6-8e96-432b-8a35-094148e94d28 (61b188c6-8e96-432b-8a35-094148e94d28): created successfully Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd914589-4854-4078-96c2-2f56d4d95c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:25:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Flow 'volume_create_manager' (cfa13960-4630-4217-83c3-28aed2b92422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:25:51 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-311f1daa-b2ca-48c6-b32c-c2ba203c8710 tempest-DeleteServersTestJSON-1019658377 None] Created volume successfully. Sep 16 01:25:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-a4fe11cc-ed6c-421a-9b7a-3b808ab52de4 req-4ce88447-2ce5-4516-a50d-58922511d14c tempest-DeleteServersTestJSON-1019658377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:25:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-a4fe11cc-ed6c-421a-9b7a-3b808ab52de4 req-4ce88447-2ce5-4516-a50d-58922511d14c tempest-DeleteServersTestJSON-1019658377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:25:55 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd37145-b3a1-4ec3-b350-63f5623566cd]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:25:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-a4fe11cc-ed6c-421a-9b7a-3b808ab52de4 req-4ce88447-2ce5-4516-a50d-58922511d14c tempest-DeleteServersTestJSON-1019658377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:25:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-a4fe11cc-ed6c-421a-9b7a-3b808ab52de4 req-4ce88447-2ce5-4516-a50d-58922511d14c tempest-DeleteServersTestJSON-1019658377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28" returned: 0 in 0.527s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:25:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-a4fe11cc-ed6c-421a-9b7a-3b808ab52de4 req-4ce88447-2ce5-4516-a50d-58922511d14c tempest-DeleteServersTestJSON-1019658377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.584s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:25:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-a4fe11cc-ed6c-421a-9b7a-3b808ab52de4 req-4ce88447-2ce5-4516-a50d-58922511d14c tempest-DeleteServersTestJSON-1019658377 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-61b188c6-8e96-432b-8a35-094148e94d28', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8fffeaa1-9d18-4fa0-97ff-44c8ea141892', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:25:56 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-a4fe11cc-ed6c-421a-9b7a-3b808ab52de4 req-4ce88447-2ce5-4516-a50d-58922511d14c tempest-DeleteServersTestJSON-1019658377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:25:56 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-a4fe11cc-ed6c-421a-9b7a-3b808ab52de4 req-4ce88447-2ce5-4516-a50d-58922511d14c tempest-DeleteServersTestJSON-1019658377 None] attachment_update completed successfully. Sep 16 01:26:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-0e5d51b1-3c64-4412-9d68-066b3623cc4d req-87fafa70-6469-4234-adb1-e80156e3b292 tempest-VolumesAssistedSnapshotsTest-923722077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-0e5d51b1-3c64-4412-9d68-066b3623cc4d req-87fafa70-6469-4234-adb1-e80156e3b292 tempest-VolumesAssistedSnapshotsTest-923722077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-0e5d51b1-3c64-4412-9d68-066b3623cc4d req-87fafa70-6469-4234-adb1-e80156e3b292 tempest-VolumesAssistedSnapshotsTest-923722077 None] Terminate volume connection completed successfully. Sep 16 01:26:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-0e5d51b1-3c64-4412-9d68-066b3623cc4d req-87fafa70-6469-4234-adb1-e80156e3b292 tempest-VolumesAssistedSnapshotsTest-923722077 None] Deleting attachment 6af2e4e5-b680-412f-8698-11031e476f7a. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:26:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-6b5f818a-3b8c-4934-9a8b-e31d3da7dcff req-4d8f2ae4-a377-4017-8ef9-395712e996b9 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-6b5f818a-3b8c-4934-9a8b-e31d3da7dcff req-4d8f2ae4-a377-4017-8ef9-395712e996b9 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-6b5f818a-3b8c-4934-9a8b-e31d3da7dcff req-4d8f2ae4-a377-4017-8ef9-395712e996b9 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Terminate volume connection completed successfully. Sep 16 01:26:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-6b5f818a-3b8c-4934-9a8b-e31d3da7dcff req-4d8f2ae4-a377-4017-8ef9-395712e996b9 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Deleting attachment 2c6fe254-a90f-4250-a4e1-209db0b163bd. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Acquiring lock "cinder-cf0db550-4e1d-4218-9eda-480653348c86-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "cinder-cf0db550-4e1d-4218-9eda-480653348c86-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:26:03 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Acquiring lock "cinder-quobyte-cf0db550-4e1d-4218-9eda-480653348c86" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "cinder-quobyte-cf0db550-4e1d-4218-9eda-480653348c86" acquired by "delete_volume" :: waited 0.051s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d62214-4f0e-4b56-9237-75e5cca0d0e1]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:26:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.552s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:26:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86" returned: 0 in 1.563s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cf0db550-4e1d-4218-9eda-480653348c86" returned: 0 in 0.106s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "cinder-quobyte-cf0db550-4e1d-4218-9eda-480653348c86" released by "delete_volume" :: held 2.092s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Created reservations ['431cec65-fcd1-4201-897b-db1571f4e2df', '23f9eee5-6d77-4f0e-8d72-cd0bf0e65316', '5399f765-e520-4087-9c0a-7aa06d341d23', '02ec253f-8e2f-4e5f-8a0c-d52471187b3c'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.082s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:26:06 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Deleted volume successfully. Sep 16 01:26:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-002e2922-e0e2-428c-8a9b-c2e3c5ef59f8 tempest-VolumesAssistedSnapshotsTest-923722077 None] Lock "cinder-cf0db550-4e1d-4218-9eda-480653348c86-delete_volume" released by "delete_volume" :: held 3.174s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:26:08 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-1ef84855-73aa-44eb-8662-3d55e6415533 req-29956dd9-7eaf-4e4b-ae43-79b683907d13 tempest-DeleteServersTestJSON-1019658377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:08 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-1ef84855-73aa-44eb-8662-3d55e6415533 req-29956dd9-7eaf-4e4b-ae43-79b683907d13 tempest-DeleteServersTestJSON-1019658377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:08 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-1ef84855-73aa-44eb-8662-3d55e6415533 req-29956dd9-7eaf-4e4b-ae43-79b683907d13 tempest-DeleteServersTestJSON-1019658377 None] Terminate volume connection completed successfully. Sep 16 01:26:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-1ef84855-73aa-44eb-8662-3d55e6415533 req-29956dd9-7eaf-4e4b-ae43-79b683907d13 tempest-DeleteServersTestJSON-1019658377 None] Deleting attachment 8fffeaa1-9d18-4fa0-97ff-44c8ea141892. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:26:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Acquiring lock "cinder-61b188c6-8e96-432b-8a35-094148e94d28-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:26:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Lock "cinder-61b188c6-8e96-432b-8a35-094148e94d28-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:26:14 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Acquiring lock "cinder-quobyte-61b188c6-8e96-432b-8a35-094148e94d28" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:26:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Lock "cinder-quobyte-61b188c6-8e96-432b-8a35-094148e94d28" acquired by "delete_volume" :: waited 0.017s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:26:14 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[80893fd1-0dbe-40b7-8abf-7a9dcd97e40e]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:26:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28" returned: 0 in 0.617s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-61b188c6-8e96-432b-8a35-094148e94d28" returned: 0 in 0.132s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Lock "cinder-quobyte-61b188c6-8e96-432b-8a35-094148e94d28" released by "delete_volume" :: held 0.988s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Created reservations ['16597949-e22d-44f8-987e-0727ff25c322', 'a920a383-1b41-454b-8c64-09d4bb117135', '6fd38a27-b1c2-40c0-8577-fae71d5f7a96', 'fa83879c-1f79-471d-940a-ed29e9d5f043'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.292s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:26:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Deleted volume successfully. Sep 16 01:26:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b4b3a934-54e7-479b-bd18-01eb6fdc85a6 tempest-DeleteServersTestJSON-1019658377 None] Lock "cinder-61b188c6-8e96-432b-8a35-094148e94d28-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:26:18 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Acquiring lock "cinder-3181cacc-5626-45c4-99a0-234069379603-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "cinder-3181cacc-5626-45c4-99a0-234069379603-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:26:19 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Acquiring lock "cinder-quobyte-3181cacc-5626-45c4-99a0-234069379603" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "cinder-quobyte-3181cacc-5626-45c4-99a0-234069379603" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3d47e4-4e9c-4276-b145-be80fd3ca09f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603" returned: 0 in 0.431s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3181cacc-5626-45c4-99a0-234069379603" returned: 0 in 0.134s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "cinder-quobyte-3181cacc-5626-45c4-99a0-234069379603" released by "delete_volume" :: held 0.869s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Created reservations ['5ee1085f-cbb8-4c05-b3ec-025a0a062e06', '987c6bed-35dd-4f80-991a-915db6185142', '0237d706-e3ff-425e-9c51-d0b984d11254', 'dbcdcb28-9607-456f-a1e8-fbf2dcab45b9'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.127s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:26:20 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:26:20 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Deleted volume successfully. Sep 16 01:26:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-42194144-41fb-4432-93ac-a71b00fe2c21 tempest-AttachSCSIVolumeTestJSON-1290406766 None] Lock "cinder-3181cacc-5626-45c4-99a0-234069379603-delete_volume" released by "delete_volume" :: held 2.173s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:26:30 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=29,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=6 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:26:31 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=27,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:27:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:27:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:27:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:27:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:27:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:27:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:27:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:27:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.181s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:27:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:27:28 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:27:28 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Flow 'volume_create_manager' (00b7a3eb-a94f-4317-b6de-2ea367dcac5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3714a0c9-3650-4ca2-b458-f161e1f591bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3714a0c9-3650-4ca2-b458-f161e1f591bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1983076970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebdbfa4-e8bb-46af-936d-0e53a7e54549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8ae07eadde4f02b6f68479dd8062c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:27:28Z,use_quota=True,user_id='baac0d4d2f334473b4dc6d0894b3120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5071c77-f593-4b20-8d3a-1344536fe21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5071c77-f593-4b20-8d3a-1344536fe21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe33114-8097-46ea-ba1b-cbe72ea7c4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe33114-8097-46ea-ba1b-cbe72ea7c4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebdbfa4-e8bb-46af-936d-0e53a7e54549', 'volume_name': 'volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5bb129-936a-4544-a364-c3d86635b416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c5bb129-936a-4544-a364-c3d86635b416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596fc887-e3c5-40dc-b22c-c476c44a9bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:27:29 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Volume 7ebdbfa4-e8bb-46af-936d-0e53a7e54549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549', 'volume_size': 1} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1983076970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebdbfa4-e8bb-46af-936d-0e53a7e54549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b8ae07eadde4f02b6f68479dd8062c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:27:28Z,use_quota=True,user_id='baac0d4d2f334473b4dc6d0894b3120c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Creating volume 7ebdbfa4-e8bb-46af-936d-0e53a7e54549 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:27:29 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:27:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:27:29 devstack quobyte-client[83066]: System call of process 85460 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:27:29 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=6, name=volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549 1073741824" returned: 0 in 0.496s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549" returned: 0 in 0.338s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] <== create_volume: return (974ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (596fc887-e3c5-40dc-b22c-c476c44a9bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c40bf3-f79d-4cd2-8959-3eaac25a87b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:27:30 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Volume volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549 (7ebdbfa4-e8bb-46af-936d-0e53a7e54549): created successfully Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8c40bf3-f79d-4cd2-8959-3eaac25a87b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:27:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Flow 'volume_create_manager' (00b7a3eb-a94f-4317-b6de-2ea367dcac5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:27:30 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5db6e8a0-793e-4582-b0c2-cbf2a36d6b9a tempest-TaggedAttachmentsTest-1005549597 None] Created volume successfully. Sep 16 01:27:40 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:27:41 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:28:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:28:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:28:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:28:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:28:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:28:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:28:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:28:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.244s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:28:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:28:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:28:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:28:39 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Flow 'volume_create_manager' (a9032888-5ecf-4c6b-9d20-53276ff2e1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af6c27c-8d0d-4617-aee0-c2eb95ef78f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6af6c27c-8d0d-4617-aee0-c2eb95ef78f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2114818747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1058257d-fba8-4c4e-9786-14938f02751c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d05ca4a12242ac9f8ed30cd1274716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:28:39Z,use_quota=True,user_id='84c97f3edc3f492d941f8a626b05c20b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf5b548-f7f5-4619-900c-a0a364961923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf5b548-f7f5-4619-900c-a0a364961923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fee0180-497b-4d65-845f-b2de6c993c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fee0180-497b-4d65-845f-b2de6c993c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1058257d-fba8-4c4e-9786-14938f02751c', 'volume_name': 'volume-1058257d-fba8-4c4e-9786-14938f02751c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01159fc5-5e5f-4f94-9b63-62d7b34d7651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01159fc5-5e5f-4f94-9b63-62d7b34d7651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a19a3a3-f97b-4a0b-8aa0-a421af2972fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:39 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Volume 1058257d-fba8-4c4e-9786-14938f02751c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1058257d-fba8-4c4e-9786-14938f02751c', 'volume_size': 1} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2114818747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1058257d-fba8-4c4e-9786-14938f02751c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d05ca4a12242ac9f8ed30cd1274716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:28:39Z,use_quota=True,user_id='84c97f3edc3f492d941f8a626b05c20b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Creating volume 1058257d-fba8-4c4e-9786-14938f02751c {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:28:39 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:28:39 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=7, name=volume-1058257d-fba8-4c4e-9786-14938f02751c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c 1073741824" returned: 0 in 0.398s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:28:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:28:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c" returned: 0 in 0.095s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:28:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] <== create_volume: return (612ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:28:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.640s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:28:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a19a3a3-f97b-4a0b-8aa0-a421af2972fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1058257d-fba8-4c4e-9786-14938f02751c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947fa2e7-321a-48cf-935d-1464927ebba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:40 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Volume volume-1058257d-fba8-4c4e-9786-14938f02751c (1058257d-fba8-4c4e-9786-14938f02751c): created successfully Sep 16 01:28:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947fa2e7-321a-48cf-935d-1464927ebba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Flow 'volume_create_manager' (a9032888-5ecf-4c6b-9d20-53276ff2e1c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:28:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-c838454b-952c-4cd6-bfa7-5729e6c7c5a8 tempest-AttachVolumeTestJSON-1172142503 None] Created volume successfully. Sep 16 01:28:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-11a06f77-5006-47f4-b3a8-a05ebb3c1a18 req-c7d4a438-d4d7-4826-ba07-0427d91331d2 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:28:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-11a06f77-5006-47f4-b3a8-a05ebb3c1a18 req-c7d4a438-d4d7-4826-ba07-0427d91331d2 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:28:45 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1895b8-a7e1-4149-ba03-81335a755fe7]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:28:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-11a06f77-5006-47f4-b3a8-a05ebb3c1a18 req-c7d4a438-d4d7-4826-ba07-0427d91331d2 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:28:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-11a06f77-5006-47f4-b3a8-a05ebb3c1a18 req-c7d4a438-d4d7-4826-ba07-0427d91331d2 tempest-AttachVolumeTestJSON-1172142503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c" returned: 0 in 0.443s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:28:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-11a06f77-5006-47f4-b3a8-a05ebb3c1a18 req-c7d4a438-d4d7-4826-ba07-0427d91331d2 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.512s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:28:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-11a06f77-5006-47f4-b3a8-a05ebb3c1a18 req-c7d4a438-d4d7-4826-ba07-0427d91331d2 tempest-AttachVolumeTestJSON-1172142503 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-1058257d-fba8-4c4e-9786-14938f02751c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1d5ed17d-2e50-49b2-b57f-2a09d011e653', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:28:46 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-11a06f77-5006-47f4-b3a8-a05ebb3c1a18 req-c7d4a438-d4d7-4826-ba07-0427d91331d2 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:28:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-11a06f77-5006-47f4-b3a8-a05ebb3c1a18 req-c7d4a438-d4d7-4826-ba07-0427d91331d2 tempest-AttachVolumeTestJSON-1172142503 None] attachment_update completed successfully. Sep 16 01:28:56 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=5,cinder:UPDATE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:28:56 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=8,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:28:59 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Flow 'volume_create_manager' (debf892a-a268-4060-9ca2-418ca7c3b115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7185ccda-1c11-4437-b391-534ee1b2887e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7185ccda-1c11-4437-b391-534ee1b2887e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-990123919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02e18fb-a457-4dab-ac6f-10a2ba444470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca92973bf534b7eb957fa505626d506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:28:59Z,use_quota=True,user_id='0928ace6e0a64b31a72a29066868e6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7b9c95-d452-42a8-a28f-8828573defc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf7b9c95-d452-42a8-a28f-8828573defc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bc9a5f-22dc-4d19-a86a-c94d0a152c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bc9a5f-22dc-4d19-a86a-c94d0a152c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd02e18fb-a457-4dab-ac6f-10a2ba444470', 'volume_name': 'volume-d02e18fb-a457-4dab-ac6f-10a2ba444470', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8503ffa5-0e3c-41f1-9512-e99885391673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8503ffa5-0e3c-41f1-9512-e99885391673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3364cde-3850-4560-abc1-513554ccc255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:28:59 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume d02e18fb-a457-4dab-ac6f-10a2ba444470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d02e18fb-a457-4dab-ac6f-10a2ba444470', 'volume_size': 1} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-990123919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02e18fb-a457-4dab-ac6f-10a2ba444470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca92973bf534b7eb957fa505626d506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:28:59Z,use_quota=True,user_id='0928ace6e0a64b31a72a29066868e6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Creating volume d02e18fb-a457-4dab-ac6f-10a2ba444470 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:28:59 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:28:59 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=8, name=volume-d02e18fb-a457-4dab-ac6f-10a2ba444470, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470 1073741824" returned: 0 in 0.376s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:28:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:29:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470" returned: 0 in 0.133s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:29:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] <== create_volume: return (815ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:29:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:29:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3364cde-3850-4560-abc1-513554ccc255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d02e18fb-a457-4dab-ac6f-10a2ba444470', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:29:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1bade3-0a8e-47f8-8784-94ebe998732f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:29:01 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume volume-d02e18fb-a457-4dab-ac6f-10a2ba444470 (d02e18fb-a457-4dab-ac6f-10a2ba444470): created successfully Sep 16 01:29:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d1bade3-0a8e-47f8-8784-94ebe998732f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:29:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Flow 'volume_create_manager' (debf892a-a268-4060-9ca2-418ca7c3b115) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:29:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-42319eaf-bff5-4599-ba2b-aa6eeef223e4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Created volume successfully. Sep 16 01:29:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:29:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:29:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:29:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:29:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:29:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:29:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:29:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.222s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:29:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:29:11 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:29:11 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:29:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-163190b8-b017-4439-9a5c-259e4b8754cf req-9a827593-c2ef-44e0-b995-ef60b432d938 tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:29:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-163190b8-b017-4439-9a5c-259e4b8754cf req-9a827593-c2ef-44e0-b995-ef60b432d938 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:29:40 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca0c4c1-f163-40db-9ec1-90b9af4174f3]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:29:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-163190b8-b017-4439-9a5c-259e4b8754cf req-9a827593-c2ef-44e0-b995-ef60b432d938 tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:29:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-163190b8-b017-4439-9a5c-259e4b8754cf req-9a827593-c2ef-44e0-b995-ef60b432d938 tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470" returned: 0 in 0.723s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:29:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-163190b8-b017-4439-9a5c-259e4b8754cf req-9a827593-c2ef-44e0-b995-ef60b432d938 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.863s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:29:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-163190b8-b017-4439-9a5c-259e4b8754cf req-9a827593-c2ef-44e0-b995-ef60b432d938 tempest-AttachVolumeShelveTestJSON-1523463275 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-d02e18fb-a457-4dab-ac6f-10a2ba444470', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92d576d9-77b9-4c90-860b-3ae84c37b90e', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:29:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-163190b8-b017-4439-9a5c-259e4b8754cf req-9a827593-c2ef-44e0-b995-ef60b432d938 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:29:41 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-163190b8-b017-4439-9a5c-259e4b8754cf req-9a827593-c2ef-44e0-b995-ef60b432d938 tempest-AttachVolumeShelveTestJSON-1523463275 None] attachment_update completed successfully. Sep 16 01:29:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6ce624c5-b8eb-430c-a1af-40eac2c41eb7 req-b88a4ae5-815a-4362-85e0-a3c3c70939c1 tempest-TaggedAttachmentsTest-1005549597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:29:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6ce624c5-b8eb-430c-a1af-40eac2c41eb7 req-b88a4ae5-815a-4362-85e0-a3c3c70939c1 tempest-TaggedAttachmentsTest-1005549597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:29:46 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c82e437-4e04-46c5-9560-cf76fd32e207]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:29:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-6ce624c5-b8eb-430c-a1af-40eac2c41eb7 req-b88a4ae5-815a-4362-85e0-a3c3c70939c1 tempest-TaggedAttachmentsTest-1005549597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:29:47 devstack quobyte-client[83066]: System call of process 86987 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:29:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-6ce624c5-b8eb-430c-a1af-40eac2c41eb7 req-b88a4ae5-815a-4362-85e0-a3c3c70939c1 tempest-TaggedAttachmentsTest-1005549597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549" returned: 0 in 0.659s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:29:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6ce624c5-b8eb-430c-a1af-40eac2c41eb7 req-b88a4ae5-815a-4362-85e0-a3c3c70939c1 tempest-TaggedAttachmentsTest-1005549597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.716s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:29:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-6ce624c5-b8eb-430c-a1af-40eac2c41eb7 req-b88a4ae5-815a-4362-85e0-a3c3c70939c1 tempest-TaggedAttachmentsTest-1005549597 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58c07e6e-feb4-4b9f-b800-824e18ccfcbd', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:29:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-6ce624c5-b8eb-430c-a1af-40eac2c41eb7 req-b88a4ae5-815a-4362-85e0-a3c3c70939c1 tempest-TaggedAttachmentsTest-1005549597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:29:47 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-6ce624c5-b8eb-430c-a1af-40eac2c41eb7 req-b88a4ae5-815a-4362-85e0-a3c3c70939c1 tempest-TaggedAttachmentsTest-1005549597 None] attachment_update completed successfully. Sep 16 01:29:57 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:29:57 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=11,cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.145s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:30:03 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:30:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:30:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:30:20 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-cfbf3678-8146-4709-86c1-a63e189eb11f req-27d63abd-503b-4d70-8867-44d0a203c536 tempest-TaggedAttachmentsTest-1005549597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:30:21 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-cfbf3678-8146-4709-86c1-a63e189eb11f req-27d63abd-503b-4d70-8867-44d0a203c536 tempest-TaggedAttachmentsTest-1005549597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:30:21 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-cfbf3678-8146-4709-86c1-a63e189eb11f req-27d63abd-503b-4d70-8867-44d0a203c536 tempest-TaggedAttachmentsTest-1005549597 None] Terminate volume connection completed successfully. Sep 16 01:30:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-cfbf3678-8146-4709-86c1-a63e189eb11f req-27d63abd-503b-4d70-8867-44d0a203c536 tempest-TaggedAttachmentsTest-1005549597 None] Deleting attachment 58c07e6e-feb4-4b9f-b800-824e18ccfcbd. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:30:31 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:30:54 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-b55257e3-ddc1-49cc-ae3a-ab81ea9bff41 req-f9d51f56-6593-4ad0-b401-e3e5a0060d46 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:30:54 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-b55257e3-ddc1-49cc-ae3a-ab81ea9bff41 req-f9d51f56-6593-4ad0-b401-e3e5a0060d46 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:30:54 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-b55257e3-ddc1-49cc-ae3a-ab81ea9bff41 req-f9d51f56-6593-4ad0-b401-e3e5a0060d46 tempest-AttachVolumeTestJSON-1172142503 None] Terminate volume connection completed successfully. Sep 16 01:30:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-b55257e3-ddc1-49cc-ae3a-ab81ea9bff41 req-f9d51f56-6593-4ad0-b401-e3e5a0060d46 tempest-AttachVolumeTestJSON-1172142503 None] Deleting attachment 1d5ed17d-2e50-49b2-b57f-2a09d011e653. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:31:04 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:31:04 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Acquiring lock "cinder-7ebdbfa4-e8bb-46af-936d-0e53a7e54549-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Lock "cinder-7ebdbfa4-e8bb-46af-936d-0e53a7e54549-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:31:05 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Acquiring lock "cinder-quobyte-7ebdbfa4-e8bb-46af-936d-0e53a7e54549" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Lock "cinder-quobyte-7ebdbfa4-e8bb-46af-936d-0e53a7e54549" acquired by "delete_volume" :: waited 0.018s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6f7260-77c0-45a3-b625-dc8a9d8d46b9]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549" returned: 0 in 0.460s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7ebdbfa4-e8bb-46af-936d-0e53a7e54549" returned: 0 in 0.076s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:31:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Lock "cinder-quobyte-7ebdbfa4-e8bb-46af-936d-0e53a7e54549" released by "delete_volume" :: held 0.683s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Created reservations ['cb02dc49-b517-43f0-b952-d46bb4c5e02b', '540686fa-b8a8-4cb5-ab4d-4473f4e81df1', 'd2eb24d5-846e-458b-8014-f2ca8735571d', 'a3a1f2ee-eace-40ab-b556-06dfb3ef7b34'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.075s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:31:06 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Deleted volume successfully. Sep 16 01:31:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a50ccecc-f884-4e0e-b301-09cafd62a6e5 tempest-TaggedAttachmentsTest-1005549597 None] Lock "cinder-7ebdbfa4-e8bb-46af-936d-0e53a7e54549-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:31:16 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=4,cinder:UPDATE=15 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:31:16 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=1,cinder:SELECT=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:31:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-76e6df8b-a406-4488-be39-6c4ae13c289b req-cd443bb8-4010-4ab6-92e9-dd0462203ba0 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:31:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-76e6df8b-a406-4488-be39-6c4ae13c289b req-cd443bb8-4010-4ab6-92e9-dd0462203ba0 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:31:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-76e6df8b-a406-4488-be39-6c4ae13c289b req-cd443bb8-4010-4ab6-92e9-dd0462203ba0 tempest-AttachVolumeShelveTestJSON-1523463275 None] Terminate volume connection completed successfully. Sep 16 01:31:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-76e6df8b-a406-4488-be39-6c4ae13c289b req-cd443bb8-4010-4ab6-92e9-dd0462203ba0 tempest-AttachVolumeShelveTestJSON-1523463275 None] Deleting attachment 92d576d9-77b9-4c90-860b-3ae84c37b90e. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:31:54 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:31:55 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:31:55 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:31:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Flow 'volume_create_manager' (632a248b-5ff5-4f41-b37a-1f68e45b8222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:31:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdd7025-5164-4252-88fa-766d53005f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:31:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdd7025-5164-4252-88fa-766d53005f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1632976244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a11195c8f4a0796c06b96b2607e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:31:56Z,use_quota=True,user_id='bde8919a86d94bfa801f0409817fa593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:31:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a814d60-8495-49d5-a60f-b915e180b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:31:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a814d60-8495-49d5-a60f-b915e180b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:31:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c053092-b8ed-47e2-ad9e-c127578eb251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:31:55 devstack cinder-volume[83041]: DEBUG cinder.image.glance [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Creating Keystone auth plugin from conf {{(pid=83041) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 01:31:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c053092-b8ed-47e2-ad9e-c127578eb251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c', 'volume_name': 'volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:31:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423270ca-4187-4761-8a3c-a1c97100afb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:31:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (423270ca-4187-4761-8a3c-a1c97100afb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:31:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f04351-110d-4eaf-ac2d-aafc423c466c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:31:56 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Volume 8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 01:31:56 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Cloning 8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c from image 4fb31587-8398-4719-bd55-69963b8198da at location (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]). {{(pid=83041) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 01:31:56 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 01:31:56 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Image download 20.69 MB at 20.69 MB/s Sep 16 01:31:56 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[65375872-c91d-40df-b415-b0b2928bc2f7]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:31:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:31:57 devstack sudo[87626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD Sep 16 01:31:57 devstack sudo[87626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:31:58 devstack sudo[87626]: pam_unix(sudo:session): session closed for user root Sep 16 01:31:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD" returned: 0 in 2.025s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:31:58 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Temporary image 4fb31587-8398-4719-bd55-69963b8198da is fetched for user bde8919a86d94bfa801f0409817fa593. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 01:31:59 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a61e14-478a-4537-863b-06c8c0c7b6b2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:31:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:31:59 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD Sep 16 01:31:59 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:32:02 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD" returned: 0 in 2.679s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.032s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1632976244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a11195c8f4a0796c06b96b2607e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:31:56Z,use_quota=True,user_id='bde8919a86d94bfa801f0409817fa593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Creating volume 8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:32:02 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:02 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=9, name=volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c 1073741824" returned: 0 in 0.423s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 0 in 0.189s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] <== create_volume: return (762ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Attempting download of 4fb31587-8398-4719-bd55-69963b8198da ((None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}])) to volume 8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5b8a5d-3ef5-407c-8c14-6bfe3147a494]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_czlmtk3r {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.139s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:32:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_czlmtk3r" returned: 0 in 0.779s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_czlmtk3r {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_czlmtk3r" returned: 1 in 0.562s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_czlmtk3r' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:32:04 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e39a32a-61e3-4d66-8329-fe0644cd5128]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:32:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:05 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] 4fb31587-8398-4719-bd55-69963b8198da was qcow2, converting to raw {{(pid=83041) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 01:32:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:06 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=9, name=volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:32:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 0 in 1.472s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:07 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ee44b05udevstack@QuobyteHD, size 112.00 MB, duration 1.51 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:32:07 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Converted 112.00 MB image at 74.07 MB/s Sep 16 01:32:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c 1G" returned: 0 in 0.154s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:07 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee0139f-977b-4dd6-b14b-136de2f342b8]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:32:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 0 in 0.495s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 1 in 0.466s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:32:08 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Downloaded image 4fb31587-8398-4719-bd55-69963b8198da ((None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}])) to volume 8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c successfully. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 01:32:08 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Temporary image 4fb31587-8398-4719-bd55-69963b8198da for user bde8919a86d94bfa801f0409817fa593 is deleted. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 01:32:08 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Marking volume 8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c as bootable. {{(pid=83041) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 01:32:09 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Copying metadata from image 4fb31587-8398-4719-bd55-69963b8198da to 8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c. {{(pid=83041) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 01:32:09 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Creating volume glance metadata for volume 8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c backed by image 4fb31587-8398-4719-bd55-69963b8198da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83041) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 01:32:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7f04351-110d-4eaf-ac2d-aafc423c466c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c26479-fd16-4bd5-838f-27207cbf1213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:09 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Volume volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c (8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c): created successfully Sep 16 01:32:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c26479-fd16-4bd5-838f-27207cbf1213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Flow 'volume_create_manager' (632a248b-5ff5-4f41-b37a-1f68e45b8222) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:32:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bdf86b13-a639-46cd-9b17-99937cfa6b85 tempest-TaggedBootDevicesTest-1295971343 None] Created volume successfully. Sep 16 01:32:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Flow 'volume_create_manager' (3b74018e-9502-4577-aba8-f5ba154e6aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36633653-ba42-4141-b2c4-bc2c81db3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36633653-ba42-4141-b2c4-bc2c81db3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1704541621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d157a0e3-c7e8-4aa7-a297-ce3ffa924885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a11195c8f4a0796c06b96b2607e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:32:10Z,use_quota=True,user_id='bde8919a86d94bfa801f0409817fa593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ba7219-d5d1-4cf0-8e4d-70fe8c748b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39ba7219-d5d1-4cf0-8e4d-70fe8c748b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c82f80-6e06-4761-815a-61860a529f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c82f80-6e06-4761-815a-61860a529f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd157a0e3-c7e8-4aa7-a297-ce3ffa924885', 'volume_name': 'volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a814ac4b-d2f9-4f0f-ac70-d85b395c9765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a814ac4b-d2f9-4f0f-ac70-d85b395c9765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e208a2-885a-48c8-9bfd-47db251eb500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:10 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Volume d157a0e3-c7e8-4aa7-a297-ce3ffa924885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885', 'volume_size': 1} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:32:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1704541621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d157a0e3-c7e8-4aa7-a297-ce3ffa924885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a11195c8f4a0796c06b96b2607e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:32:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:32:10Z,use_quota=True,user_id='bde8919a86d94bfa801f0409817fa593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Creating volume d157a0e3-c7e8-4aa7-a297-ce3ffa924885 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:32:10 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:32:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:10 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=10, name=volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885 1073741824" returned: 0 in 0.404s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885" returned: 0 in 0.088s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] <== create_volume: return (566ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.578s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75e208a2-885a-48c8-9bfd-47db251eb500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60660b4-775e-4812-be1b-805230e4deed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Volume volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885 (d157a0e3-c7e8-4aa7-a297-ce3ffa924885): created successfully Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60660b4-775e-4812-be1b-805230e4deed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Flow 'volume_create_manager' (3b74018e-9502-4577-aba8-f5ba154e6aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:32:11 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f48e91f2-87bc-4c25-b32f-e64edf63f54a tempest-TaggedBootDevicesTest-1295971343 None] Created volume successfully. Sep 16 01:32:13 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Flow 'volume_create_manager' (1d6433a8-ecbb-4cb0-98fa-90214a002fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eae6ee4-c1d4-434e-81d7-fcb76ee76dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3eae6ee4-c1d4-434e-81d7-fcb76ee76dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1143035827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9bfc55-93dc-4697-b3f0-70fd0baa6459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a11195c8f4a0796c06b96b2607e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:32:13Z,use_quota=True,user_id='bde8919a86d94bfa801f0409817fa593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308f748f-3ee9-4e15-af5e-08b899d5e782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (308f748f-3ee9-4e15-af5e-08b899d5e782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccf0515-fd84-4f73-a76c-968f80948b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ccf0515-fd84-4f73-a76c-968f80948b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f9bfc55-93dc-4697-b3f0-70fd0baa6459', 'volume_name': 'volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bc98b4-ec5b-4860-8eff-79622414e84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bc98b4-ec5b-4860-8eff-79622414e84a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf4fafa-3686-434f-99b2-047b8cd7c881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:13 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Volume 2f9bfc55-93dc-4697-b3f0-70fd0baa6459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459', 'volume_size': 1} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1143035827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f9bfc55-93dc-4697-b3f0-70fd0baa6459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b93a11195c8f4a0796c06b96b2607e1b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:32:13Z,use_quota=True,user_id='bde8919a86d94bfa801f0409817fa593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Creating volume 2f9bfc55-93dc-4697-b3f0-70fd0baa6459 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:32:13 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:32:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:13 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=11, name=volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459 1073741824" returned: 0 in 0.569s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459" returned: 0 in 0.216s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] <== create_volume: return (938ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf4fafa-3686-434f-99b2-047b8cd7c881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f301fd58-9d4e-4118-abf5-1706c0862f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:32:14 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Volume volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459 (2f9bfc55-93dc-4697-b3f0-70fd0baa6459): created successfully Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f301fd58-9d4e-4118-abf5-1706c0862f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:32:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Flow 'volume_create_manager' (1d6433a8-ecbb-4cb0-98fa-90214a002fbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:32:15 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-abe48e0c-bdfe-483e-a0f4-99858af2a039 tempest-TaggedBootDevicesTest-1295971343 None] Created volume successfully. Sep 16 01:32:24 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=10,cinder:SELECT=14,cinder:INSERT=12,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:32:25 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=6,cinder:DELETE=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:32:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:44 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f230c79-552b-490e-afda-4b3818c953c7]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:32:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 0 in 0.805s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 1 in 0.807s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:32:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.983s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a47bf03-7e8f-489d-a895-9693a0a8ff91', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:32:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:32:48 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-fb4864b1-3bdd-4280-b63c-a733538ca8ea tempest-TaggedBootDevicesTest-1295971343 None] attachment_update completed successfully. Sep 16 01:32:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-74bfb26c-22a6-4c1a-9c3b-c1ec0ef11ffb tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-74bfb26c-22a6-4c1a-9c3b-c1ec0ef11ffb tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:51 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[efad1370-e08b-4c7e-81f3-9e13d81411c5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:32:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-74bfb26c-22a6-4c1a-9c3b-c1ec0ef11ffb tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:52 devstack quobyte-client[83066]: System call of process 87905 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:32:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-74bfb26c-22a6-4c1a-9c3b-c1ec0ef11ffb tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885" returned: 0 in 0.992s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-74bfb26c-22a6-4c1a-9c3b-c1ec0ef11ffb tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.105s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-74bfb26c-22a6-4c1a-9c3b-c1ec0ef11ffb tempest-TaggedBootDevicesTest-1295971343 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6d1bd9f2-82c2-448a-adaf-813a6026bdf6', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:32:53 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-74bfb26c-22a6-4c1a-9c3b-c1ec0ef11ffb tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:32:53 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-74bfb26c-22a6-4c1a-9c3b-c1ec0ef11ffb tempest-TaggedBootDevicesTest-1295971343 None] attachment_update completed successfully. Sep 16 01:32:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-bd292688-8f53-42d5-a956-3b4bd565a460 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:32:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-bd292688-8f53-42d5-a956-3b4bd565a460 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:32:57 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfcbe40-de7e-482c-80b2-1d9ab38b1696]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:32:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-bd292688-8f53-42d5-a956-3b4bd565a460 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:32:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-bd292688-8f53-42d5-a956-3b4bd565a460 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459" returned: 0 in 0.638s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:32:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-bd292688-8f53-42d5-a956-3b4bd565a460 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.776s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:32:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-bd292688-8f53-42d5-a956-3b4bd565a460 tempest-TaggedBootDevicesTest-1295971343 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f4a61fef-1ba2-43e9-8190-90344d3ec47f', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:32:58 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-bd292688-8f53-42d5-a956-3b4bd565a460 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:32:58 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-5d66f4e1-a6cb-4baa-b5de-76e3962357fb req-bd292688-8f53-42d5-a956-3b4bd565a460 tempest-TaggedBootDevicesTest-1295971343 None] attachment_update completed successfully. Sep 16 01:33:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:33:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:33:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:33:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:33:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:33:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:33:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:33:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.219s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:33:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:33:08 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=16,cinder:UPDATE=4 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:33:08 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:33:45 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:33:45 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Flow 'volume_create_manager' (6b9b6a58-3c25-45f5-ab70-5432b127ec0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36b95aa-2297-4f4e-9dc3-4304cfd2c678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36b95aa-2297-4f4e-9dc3-4304cfd2c678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1322807091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7514f565-e373-4a68-aeab-b913abb9b081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca92973bf534b7eb957fa505626d506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:33:45Z,use_quota=True,user_id='0928ace6e0a64b31a72a29066868e6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d7cfd-de25-408d-a234-07da65497a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d7cfd-de25-408d-a234-07da65497a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bfee51-4868-4bfe-a22d-41f4cd24ebca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07bfee51-4868-4bfe-a22d-41f4cd24ebca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7514f565-e373-4a68-aeab-b913abb9b081', 'volume_name': 'volume-7514f565-e373-4a68-aeab-b913abb9b081', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7540fa96-3d98-4c0e-9fa9-e8efd65d704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7540fa96-3d98-4c0e-9fa9-e8efd65d704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e93d72-b3b8-417a-8e0a-95570b7b7360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:33:46 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume 7514f565-e373-4a68-aeab-b913abb9b081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7514f565-e373-4a68-aeab-b913abb9b081', 'volume_size': 1} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1322807091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7514f565-e373-4a68-aeab-b913abb9b081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dca92973bf534b7eb957fa505626d506',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:33:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:33:45Z,use_quota=True,user_id='0928ace6e0a64b31a72a29066868e6e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Creating volume 7514f565-e373-4a68-aeab-b913abb9b081 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:33:46 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:33:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7514f565-e373-4a68-aeab-b913abb9b081 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:33:47 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=12, name=volume-7514f565-e373-4a68-aeab-b913abb9b081, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:33:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7514f565-e373-4a68-aeab-b913abb9b081 1073741824" returned: 0 in 1.705s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:33:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7514f565-e373-4a68-aeab-b913abb9b081 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:33:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7514f565-e373-4a68-aeab-b913abb9b081" returned: 0 in 0.339s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:33:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] <== create_volume: return (2280ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:33:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.319s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:33:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56e93d72-b3b8-417a-8e0a-95570b7b7360) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7514f565-e373-4a68-aeab-b913abb9b081', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:33:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0a704a-b2e0-44e0-ac70-e35a2946c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:33:50 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume volume-7514f565-e373-4a68-aeab-b913abb9b081 (7514f565-e373-4a68-aeab-b913abb9b081): created successfully Sep 16 01:33:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd0a704a-b2e0-44e0-ac70-e35a2946c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:33:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Flow 'volume_create_manager' (6b9b6a58-3c25-45f5-ab70-5432b127ec0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:33:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3c7b7c46-0e63-41dc-a71f-c4fd91ca652b tempest-AttachVolumeShelveTestJSON-1523463275 None] Created volume successfully. Sep 16 01:34:00 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:34:00 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:34:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:34:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:34:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:34:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:34:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:34:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:34:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:34:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.257s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:34:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:34:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:34:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:34:21 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-b1ee9ebe-0513-400f-b4d0-4f33d6b2b5e7 req-014bf34b-2efb-4770-ae43-be16e0bab297 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:34:21 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-b1ee9ebe-0513-400f-b4d0-4f33d6b2b5e7 req-014bf34b-2efb-4770-ae43-be16e0bab297 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:34:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-b1ee9ebe-0513-400f-b4d0-4f33d6b2b5e7 req-014bf34b-2efb-4770-ae43-be16e0bab297 tempest-AttachVolumeShelveTestJSON-1523463275 None] No connector for attachment fb5f29a6-18d9-4c36-bc66-ae7c9fded642; skipping storage backend terminate_connection call. {{(pid=83041) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}} Sep 16 01:34:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-b1ee9ebe-0513-400f-b4d0-4f33d6b2b5e7 req-014bf34b-2efb-4770-ae43-be16e0bab297 tempest-AttachVolumeShelveTestJSON-1523463275 None] Deleting attachment fb5f29a6-18d9-4c36-bc66-ae7c9fded642. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:34:31 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:34:31 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:34:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Flow 'volume_create_manager' (c3a94f51-bc51-4cb6-946e-57262a1aa902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de5d298-f83d-41fe-9800-7f786bbe46e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de5d298-f83d-41fe-9800-7f786bbe46e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1688490359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bad691a-18a9-4a78-95bd-fe5f5632cd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d05ca4a12242ac9f8ed30cd1274716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:34:42Z,use_quota=True,user_id='84c97f3edc3f492d941f8a626b05c20b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261c5238-b9be-4ca1-899b-033401c5e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261c5238-b9be-4ca1-899b-033401c5e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd69209-2fa7-4ab0-bd73-4a940dc8a35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd69209-2fa7-4ab0-bd73-4a940dc8a35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bad691a-18a9-4a78-95bd-fe5f5632cd90', 'volume_name': 'volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d2c9e8-6840-44f5-a11b-15d92825a28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d2c9e8-6840-44f5-a11b-15d92825a28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e200e1-af6c-4b7c-9573-291850fa9765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:34:42 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Volume 3bad691a-18a9-4a78-95bd-fe5f5632cd90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90', 'volume_size': 1} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1688490359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bad691a-18a9-4a78-95bd-fe5f5632cd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d05ca4a12242ac9f8ed30cd1274716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:34:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:34:42Z,use_quota=True,user_id='84c97f3edc3f492d941f8a626b05c20b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Creating volume 3bad691a-18a9-4a78-95bd-fe5f5632cd90 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:34:42 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:34:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:34:43 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=13, name=volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:34:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90 1073741824" returned: 0 in 0.757s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:34:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:34:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90" returned: 0 in 0.407s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:34:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] <== create_volume: return (1462ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:34:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:34:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40e200e1-af6c-4b7c-9573-291850fa9765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:34:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3a84e0-c9b5-486b-8bee-6da8e028b5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:34:44 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Volume volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90 (3bad691a-18a9-4a78-95bd-fe5f5632cd90): created successfully Sep 16 01:34:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3a84e0-c9b5-486b-8bee-6da8e028b5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:34:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Flow 'volume_create_manager' (c3a94f51-bc51-4cb6-946e-57262a1aa902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:34:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-adf7dede-02b0-48b8-8d7c-c416a5123b07 tempest-AttachVolumeTestJSON-1172142503 None] Created volume successfully. Sep 16 01:34:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-0bae2b0b-4cb5-415d-a688-b9e668d9e75c req-887b045f-49f0-4939-a54d-8c376ab9a7ee tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:34:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-0bae2b0b-4cb5-415d-a688-b9e668d9e75c req-887b045f-49f0-4939-a54d-8c376ab9a7ee tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:34:50 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c75594-8f4d-45a6-9e43-239c4f819930]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:34:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-0bae2b0b-4cb5-415d-a688-b9e668d9e75c req-887b045f-49f0-4939-a54d-8c376ab9a7ee tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:34:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-0bae2b0b-4cb5-415d-a688-b9e668d9e75c req-887b045f-49f0-4939-a54d-8c376ab9a7ee tempest-AttachVolumeTestJSON-1172142503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90" returned: 0 in 0.646s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:34:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-0bae2b0b-4cb5-415d-a688-b9e668d9e75c req-887b045f-49f0-4939-a54d-8c376ab9a7ee tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.733s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:34:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-0bae2b0b-4cb5-415d-a688-b9e668d9e75c req-887b045f-49f0-4939-a54d-8c376ab9a7ee tempest-AttachVolumeTestJSON-1172142503 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31ebade9-0db9-4f64-8630-6b891041d84c', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:34:51 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-0bae2b0b-4cb5-415d-a688-b9e668d9e75c req-887b045f-49f0-4939-a54d-8c376ab9a7ee tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:34:51 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-0bae2b0b-4cb5-415d-a688-b9e668d9e75c req-887b045f-49f0-4939-a54d-8c376ab9a7ee tempest-AttachVolumeTestJSON-1172142503 None] attachment_update completed successfully. Sep 16 01:35:00 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Flow 'volume_create_manager' (35266ac6-a85d-4ca9-9047-005383b25eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c2656e-8f06-4f60-9a41-f88ea74b685a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c2656e-8f06-4f60-9a41-f88ea74b685a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-371576591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d05ca4a12242ac9f8ed30cd1274716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:35:00Z,use_quota=True,user_id='84c97f3edc3f492d941f8a626b05c20b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e4a632-fa47-477f-9bd3-645e50336a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e4a632-fa47-477f-9bd3-645e50336a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da9213a-9d7d-4052-bc52-de36f87d89ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9da9213a-9d7d-4052-bc52-de36f87d89ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de', 'volume_name': 'volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a283cc75-5912-4a47-ab51-6bf80387bc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a283cc75-5912-4a47-ab51-6bf80387bc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5e783f-e163-42b6-b7d2-0b1e8bd72462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:35:00 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Volume 5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de', 'volume_size': 1} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-371576591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93d05ca4a12242ac9f8ed30cd1274716',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:35:00Z,use_quota=True,user_id='84c97f3edc3f492d941f8a626b05c20b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Creating volume 5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:35:00 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:35:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:35:00 devstack quobyte-client[83066]: System call of process 89351 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:35:01 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=14, name=volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:35:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de 1073741824" returned: 0 in 1.007s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:35:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:35:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de" returned: 0 in 0.223s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:35:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] <== create_volume: return (1390ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:35:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:35:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d5e783f-e163-42b6-b7d2-0b1e8bd72462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:35:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5e213f-61a0-4b74-bf58-df9e13eb504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:35:02 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Volume volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de (5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de): created successfully Sep 16 01:35:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5e213f-61a0-4b74-bf58-df9e13eb504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:35:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Flow 'volume_create_manager' (35266ac6-a85d-4ca9-9047-005383b25eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:35:02 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-c0caee18-1f9e-481b-91e2-d26e1092a62d tempest-AttachVolumeTestJSON-1172142503 None] Created volume successfully. Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.154s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:35:03 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:35:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-f9642b46-cc4a-4540-889f-227c16e6e889 req-8bf22fbf-f9df-4119-bded-239bb2395cce tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:35:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-f9642b46-cc4a-4540-889f-227c16e6e889 req-8bf22fbf-f9df-4119-bded-239bb2395cce tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:35:07 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efd8cd-c54a-4a8d-875e-d723dd522dfa]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:35:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-f9642b46-cc4a-4540-889f-227c16e6e889 req-8bf22fbf-f9df-4119-bded-239bb2395cce tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:35:08 devstack quobyte-client[83066]: System call of process 89377 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:35:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-f9642b46-cc4a-4540-889f-227c16e6e889 req-8bf22fbf-f9df-4119-bded-239bb2395cce tempest-AttachVolumeTestJSON-1172142503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de" returned: 0 in 0.570s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:35:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-f9642b46-cc4a-4540-889f-227c16e6e889 req-8bf22fbf-f9df-4119-bded-239bb2395cce tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.628s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:35:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-f9642b46-cc4a-4540-889f-227c16e6e889 req-8bf22fbf-f9df-4119-bded-239bb2395cce tempest-AttachVolumeTestJSON-1172142503 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f2d80a3-f3ee-4ca1-ab83-31ec4e579bde', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:35:08 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-f9642b46-cc4a-4540-889f-227c16e6e889 req-8bf22fbf-f9df-4119-bded-239bb2395cce tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:35:08 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-f9642b46-cc4a-4540-889f-227c16e6e889 req-8bf22fbf-f9df-4119-bded-239bb2395cce tempest-AttachVolumeTestJSON-1172142503 None] attachment_update completed successfully. Sep 16 01:35:18 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=8,cinder:SELECT=15,cinder:DELETE=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:35:18 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=11,cinder:UPDATE=6 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:35:37 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-3dd6f63c-227a-429b-aeed-bf9fb8ed3af9 req-375f7acf-8661-4ff2-a221-0cf8e51a4697 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:35:37 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-3dd6f63c-227a-429b-aeed-bf9fb8ed3af9 req-375f7acf-8661-4ff2-a221-0cf8e51a4697 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:35:37 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-3dd6f63c-227a-429b-aeed-bf9fb8ed3af9 req-375f7acf-8661-4ff2-a221-0cf8e51a4697 tempest-AttachVolumeTestJSON-1172142503 None] Terminate volume connection completed successfully. Sep 16 01:35:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-3dd6f63c-227a-429b-aeed-bf9fb8ed3af9 req-375f7acf-8661-4ff2-a221-0cf8e51a4697 tempest-AttachVolumeTestJSON-1172142503 None] Deleting attachment 31ebade9-0db9-4f64-8630-6b891041d84c. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:35:47 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:35:47 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:36:00 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-81cbdb2d-32fc-4154-937a-a8afbc871afc req-e5b44eab-e147-4682-a7af-eb42d4ee378c tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:00 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-81cbdb2d-32fc-4154-937a-a8afbc871afc req-e5b44eab-e147-4682-a7af-eb42d4ee378c tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-81cbdb2d-32fc-4154-937a-a8afbc871afc req-e5b44eab-e147-4682-a7af-eb42d4ee378c tempest-AttachVolumeTestJSON-1172142503 None] Terminate volume connection completed successfully. Sep 16 01:36:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-81cbdb2d-32fc-4154-937a-a8afbc871afc req-e5b44eab-e147-4682-a7af-eb42d4ee378c tempest-AttachVolumeTestJSON-1172142503 None] Deleting attachment 5f2d80a3-f3ee-4ca1-ab83-31ec4e579bde. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:36:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:36:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.061s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.409s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-15298034-14b9-4ecd-a0bd-888da4466da0 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-15298034-14b9-4ecd-a0bd-888da4466da0 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:10 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-15298034-14b9-4ecd-a0bd-888da4466da0 tempest-TaggedBootDevicesTest-1295971343 None] Terminate volume connection completed successfully. Sep 16 01:36:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-15298034-14b9-4ecd-a0bd-888da4466da0 tempest-TaggedBootDevicesTest-1295971343 None] Deleting attachment 6a47bf03-7e8f-489d-a895-9693a0a8ff91. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:36:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-512e7455-ef6b-4ae7-9827-f8d9b0e6c16b tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-512e7455-ef6b-4ae7-9827-f8d9b0e6c16b tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:11 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-512e7455-ef6b-4ae7-9827-f8d9b0e6c16b tempest-TaggedBootDevicesTest-1295971343 None] Terminate volume connection completed successfully. Sep 16 01:36:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-512e7455-ef6b-4ae7-9827-f8d9b0e6c16b tempest-TaggedBootDevicesTest-1295971343 None] Deleting attachment 6d1bd9f2-82c2-448a-adaf-813a6026bdf6. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:36:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-94044d02-686b-4d17-8867-4f45eef8aae0 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-94044d02-686b-4d17-8867-4f45eef8aae0 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-94044d02-686b-4d17-8867-4f45eef8aae0 tempest-TaggedBootDevicesTest-1295971343 None] Terminate volume connection completed successfully. Sep 16 01:36:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-ad55b022-488f-4ed2-8fd6-f05a782d5b20 req-94044d02-686b-4d17-8867-4f45eef8aae0 tempest-TaggedBootDevicesTest-1295971343 None] Deleting attachment f4a61fef-1ba2-43e9-8190-90344d3ec47f. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:36:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "cinder-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "cinder-quobyte-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-quobyte-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de" acquired by "delete_volume" :: waited 0.024s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:15 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[db420e7d-7f8c-46d4-8832-50dde7c0a39c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de" returned: 0 in 0.642s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de" returned: 0 in 0.089s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-quobyte-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de" released by "delete_volume" :: held 0.904s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Created reservations ['22f7cf6b-be20-451a-b169-e11226cfb453', 'ac87967b-51f9-4f62-8b41-76e630855aee', '6b30dddc-87c1-4a74-a21b-9f0852944a5a', '08d8ff7d-690a-4f24-a80e-e2d6abccb28e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.084s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:17 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Deleted volume successfully. Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c8a2b271-d22d-4391-849b-a05155cab314 tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-5f2b4556-0a6a-46ca-9a1e-c1ddf8e813de-delete_volume" released by "delete_volume" :: held 2.016s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "cinder-3bad691a-18a9-4a78-95bd-fe5f5632cd90-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-3bad691a-18a9-4a78-95bd-fe5f5632cd90-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:17 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "cinder-quobyte-3bad691a-18a9-4a78-95bd-fe5f5632cd90" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-quobyte-3bad691a-18a9-4a78-95bd-fe5f5632cd90" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c289fa-41bf-441d-a0ad-9591488d0f65]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90" returned: 0 in 0.487s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3bad691a-18a9-4a78-95bd-fe5f5632cd90" returned: 0 in 0.107s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:18 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-quobyte-3bad691a-18a9-4a78-95bd-fe5f5632cd90" released by "delete_volume" :: held 0.753s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Created reservations ['0c00ee92-4610-48f1-9f23-a0527dbb69ab', 'cb2137bc-d964-4d45-9a4f-4aff8e583069', '6808ba33-4fe8-49e6-8020-c4cce30d903c', 'fc019dbc-a73e-4306-8dcb-6ce36e0b0438'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:19 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Deleted volume successfully. Sep 16 01:36:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-34df292e-3abc-418f-aa65-da6c2591a5cb tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-3bad691a-18a9-4a78-95bd-fe5f5632cd90-delete_volume" released by "delete_volume" :: held 1.891s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "cinder-1058257d-fba8-4c4e-9786-14938f02751c-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-1058257d-fba8-4c4e-9786-14938f02751c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:20 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "cinder-quobyte-1058257d-fba8-4c4e-9786-14938f02751c" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-quobyte-1058257d-fba8-4c4e-9786-14938f02751c" acquired by "delete_volume" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:20 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3927ac6-ac30-412e-a8e3-90106013bd48]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c" returned: 0 in 0.457s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1058257d-fba8-4c4e-9786-14938f02751c" returned: 0 in 0.215s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-quobyte-1058257d-fba8-4c4e-9786-14938f02751c" released by "delete_volume" :: held 1.034s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "cinder-2f9bfc55-93dc-4697-b3f0-70fd0baa6459-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-2f9bfc55-93dc-4697-b3f0-70fd0baa6459-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Created reservations ['72d8fb24-bb75-40aa-b805-f35beb422214', '72f17885-9c35-4ae5-8289-e50435c5100e', '346f0665-9dad-49b8-b53a-1f51114eee48', 'bd0045ad-1882-4586-ab57-8d08fe393a34'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:22 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "cinder-quobyte-2f9bfc55-93dc-4697-b3f0-70fd0baa6459" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-quobyte-2f9bfc55-93dc-4697-b3f0-70fd0baa6459" acquired by "delete_volume" :: waited 0.061s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45293c9-d0db-41e1-b025-59945e12ce77]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.305s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:22 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:22 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Deleted volume successfully. Sep 16 01:36:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4dbb563-3b23-4339-8824-5f21613d3270 tempest-AttachVolumeTestJSON-1172142503 None] Lock "cinder-1058257d-fba8-4c4e-9786-14938f02751c-delete_volume" released by "delete_volume" :: held 2.837s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459" returned: 0 in 1.017s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2f9bfc55-93dc-4697-b3f0-70fd0baa6459" returned: 0 in 0.151s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-quobyte-2f9bfc55-93dc-4697-b3f0-70fd0baa6459" released by "delete_volume" :: held 1.599s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Created reservations ['089e3790-9876-4814-88b6-846e994846ea', '518f4cc6-0e12-4d03-8bbc-878e45a89075', '4dd71a45-cc53-4996-9d77-a84c404a0001', '23c3e7c1-a9da-4124-b133-34505e374b1f'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.205s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:24 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:24 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Deleted volume successfully. Sep 16 01:36:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5ea2263d-c7f7-4972-8a8e-324c4bfb2462 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-2f9bfc55-93dc-4697-b3f0-70fd0baa6459-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "cinder-d157a0e3-c7e8-4aa7-a297-ce3ffa924885-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-d157a0e3-c7e8-4aa7-a297-ce3ffa924885-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "cinder-quobyte-d157a0e3-c7e8-4aa7-a297-ce3ffa924885" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-quobyte-d157a0e3-c7e8-4aa7-a297-ce3ffa924885" acquired by "delete_volume" :: waited 0.040s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:26 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cff24a8-8dcb-4d4f-8be2-a0dbb122ccc4]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "cinder-7514f565-e373-4a68-aeab-b913abb9b081-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:27 devstack quobyte-client[83066]: System call of process 90003 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:36:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885" returned: 0 in 1.426s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "cinder-7514f565-e373-4a68-aeab-b913abb9b081-delete_volume" acquired by "delete_volume" :: waited 0.381s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d157a0e3-c7e8-4aa7-a297-ce3ffa924885" returned: 0 in 0.358s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-quobyte-d157a0e3-c7e8-4aa7-a297-ce3ffa924885" released by "delete_volume" :: held 1.938s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:28 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "cinder-quobyte-7514f565-e373-4a68-aeab-b913abb9b081" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "cinder-quobyte-7514f565-e373-4a68-aeab-b913abb9b081" acquired by "delete_volume" :: waited 0.106s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:28 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0100fdaf-1ff5-4926-9457-87ce44cf662d]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7514f565-e373-4a68-aeab-b913abb9b081 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:28 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Created reservations ['f76de2a1-f01a-4ea3-89e4-ea2329c9c98c', '497b70be-60bd-40a6-9745-89dbe7f864f4', 'adf75bcb-65f2-49fb-b6c9-ee33556bce73', '1a10888c-3ff8-4db3-b8d4-3db535e78a5e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7514f565-e373-4a68-aeab-b913abb9b081" returned: 0 in 0.685s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7514f565-e373-4a68-aeab-b913abb9b081 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7514f565-e373-4a68-aeab-b913abb9b081" returned: 0 in 0.364s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "cinder-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "cinder-quobyte-7514f565-e373-4a68-aeab-b913abb9b081" released by "delete_volume" :: held 1.533s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.736s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c-delete_volume" acquired by "delete_volume" :: waited 0.267s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:29 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Deleted volume successfully. Sep 16 01:36:29 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Created reservations ['e3bc9413-142b-47da-bf47-c900e3d3835a', '7d958061-4789-4ac9-ba80-2d93095c27c6', 'e0a3d0e9-cca1-4de6-a661-554209ce816b', '1bc9c62d-e6d4-4e0f-a6a0-33fb670e25bc'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:30 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "cinder-quobyte-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-aacf9e67-d7f8-4220-9900-db6b36bcb8b1 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-d157a0e3-c7e8-4aa7-a297-ce3ffa924885-delete_volume" released by "delete_volume" :: held 4.785s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.364s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:30 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Deleted volume successfully. Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-quobyte-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" acquired by "delete_volume" :: waited 0.256s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b81a626e-9309-4ca3-a4fa-b0f1acd0a1f4 tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "cinder-7514f565-e373-4a68-aeab-b913abb9b081-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[514441ce-0441-4ec3-8677-5f881aa98100]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "cinder-d02e18fb-a457-4dab-ac6f-10a2ba444470-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "cinder-d02e18fb-a457-4dab-ac6f-10a2ba444470-delete_volume" acquired by "delete_volume" :: waited 0.096s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 0 in 0.636s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:31 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "cinder-quobyte-d02e18fb-a457-4dab-ac6f-10a2ba444470" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "cinder-quobyte-d02e18fb-a457-4dab-ac6f-10a2ba444470" acquired by "delete_volume" :: waited 0.060s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:31 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a102abb6-0089-48ce-a21e-fe95e5e6d746]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 1 in 0.666s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" returned: 0 in 0.149s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-quobyte-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c" released by "delete_volume" :: held 1.775s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470" returned: 0 in 0.750s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d02e18fb-a457-4dab-ac6f-10a2ba444470" returned: 0 in 0.283s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:32 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Created reservations ['a35e2ff4-153b-4e8b-bd78-b89f1945101f', 'd288ea4e-6a6c-4baa-9af6-4f5e76bf7779', '755bfc87-2e18-43c7-af82-538bf48fb1e6', 'b01ac35e-3034-4deb-9dee-affe32e19e58'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "cinder-quobyte-d02e18fb-a457-4dab-ac6f-10a2ba444470" released by "delete_volume" :: held 1.184s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Created reservations ['438a6793-f4d5-46d8-aea5-2ca2f5d105bc', '7c83a157-078d-498f-9daf-31d49db15a5d', '7866c5d8-c694-42f4-ac63-ca3d59474df8', '4b6ebcc9-f05f-4ea4-8c8d-42929b867d7d'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.185s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:33 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Deleted volume successfully. Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e2c197b3-eaf4-461c-87c5-b41b5547b688 tempest-TaggedBootDevicesTest-1295971343 None] Lock "cinder-8fd5a4e3-0c2c-4f02-ae76-776cd32ed11c-delete_volume" released by "delete_volume" :: held 3.923s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.229s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:33 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:33 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Deleted volume successfully. Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2d07fb78-8db2-452c-864f-30be1fd7866b tempest-AttachVolumeShelveTestJSON-1523463275 None] Lock "cinder-d02e18fb-a457-4dab-ac6f-10a2ba444470-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:34 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Flow 'volume_create_manager' (439b0425-3017-4f8b-a384-1e2fb777be5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a043eb-13bc-4ce4-9c33-c09d39a5bf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a043eb-13bc-4ce4-9c33-c09d39a5bf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-249695168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b36db4-165e-434f-b15a-bcfff3cf7458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b524d33002b841abba979bca62a9b5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:36:35Z,use_quota=True,user_id='dfd60ac839634bc7b01a4d0ec4927c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec2d45a-d246-495a-a425-10a762aa8dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fec2d45a-d246-495a-a425-10a762aa8dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de9e6e4-a1f2-48e5-9b5e-44e3492f349b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0de9e6e4-a1f2-48e5-9b5e-44e3492f349b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b36db4-165e-434f-b15a-bcfff3cf7458', 'volume_name': 'volume-43b36db4-165e-434f-b15a-bcfff3cf7458', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee17d1ed-f698-4575-a9e2-51d8089d7039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee17d1ed-f698-4575-a9e2-51d8089d7039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8014dd2f-a541-47cb-8694-1c959410a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:36:34 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Volume 43b36db4-165e-434f-b15a-bcfff3cf7458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b36db4-165e-434f-b15a-bcfff3cf7458', 'volume_size': 1} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-249695168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b36db4-165e-434f-b15a-bcfff3cf7458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b524d33002b841abba979bca62a9b5bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:36:35Z,use_quota=True,user_id='dfd60ac839634bc7b01a4d0ec4927c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Creating volume 43b36db4-165e-434f-b15a-bcfff3cf7458 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:36:34 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:36:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:35 devstack quobyte-client[83066]: System call of process 90038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:36:35 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=15, name=volume-43b36db4-165e-434f-b15a-bcfff3cf7458, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 1073741824" returned: 0 in 0.409s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458" returned: 0 in 0.135s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] <== create_volume: return (632ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.647s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8014dd2f-a541-47cb-8694-1c959410a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b36db4-165e-434f-b15a-bcfff3cf7458', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89668ef9-23bc-4a0c-b5be-1d388880a6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:36:35 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Volume volume-43b36db4-165e-434f-b15a-bcfff3cf7458 (43b36db4-165e-434f-b15a-bcfff3cf7458): created successfully Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89668ef9-23bc-4a0c-b5be-1d388880a6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:36:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Flow 'volume_create_manager' (439b0425-3017-4f8b-a384-1e2fb777be5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:36:35 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-af173f0f-7a6f-4443-866e-568f5c6106c7 req-316caef1-586c-4e36-9483-47e12b3fe026 tempest-VolumesSnapshotsTestJSON-1847167267 None] Created volume successfully. Sep 16 01:36:37 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Creating offline snapshot 812d6aa1-c795-4cc4-a007-b4406f90f8de of volume 43b36db4-165e-434f-b15a-bcfff3cf7458 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:36:38 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afba981-c93d-4c1e-843e-84db5fba4741]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:38 devstack quobyte-client[83066]: System call of process 90044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:36:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458" returned: 0 in 0.823s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:39 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=16, name=volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de 1G" returned: 0 in 0.403s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): qemu-img rebase -u -b volume-43b36db4-165e-434f-b15a-bcfff3cf7458 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "qemu-img rebase -u -b volume-43b36db4-165e-434f-b15a-bcfff3cf7458 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de" returned: 0 in 0.252s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de" returned: 0 in 0.147s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:36:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de" returned: 0 in 0.190s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.info" returned: 0 in 0.148s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:36:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.info" returned: 0 in 0.183s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.854s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:41 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-90244256-cbbd-49a7-af2f-99ee3908407f req-049d3f66-0802-4748-a865-58654afcac13 tempest-VolumesSnapshotsTestJSON-1847167267 None] Create snapshot completed successfully Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "cinder-812d6aa1-c795-4cc4-a007-b4406f90f8de-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-812d6aa1-c795-4cc4-a007-b4406f90f8de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "cinder-quobyte-43b36db4-165e-434f-b15a-bcfff3cf7458" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-quobyte-43b36db4-165e-434f-b15a-bcfff3cf7458" acquired by "delete_snapshot" :: waited 0.035s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "cinder-quobyte-812d6aa1-c795-4cc4-a007-b4406f90f8de" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-quobyte-812d6aa1-c795-4cc4-a007-b4406f90f8de" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Deleting offline snapshot 812d6aa1-c795-4cc4-a007-b4406f90f8de of volume 43b36db4-165e-434f-b15a-bcfff3cf7458 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] snapshot_file for this snap is: volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[90475b05-475f-47da-86d6-d4d5b3f8b3d3]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de" returned: 0 in 0.504s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43b36db4-165e-434f-b15a-bcfff3cf7458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:36:42 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccb61d4-284d-4d3d-9015-136d2ada7382]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458" returned: 0 in 0.647s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de" returned: 0 in 0.307s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458.812d6aa1-c795-4cc4-a007-b4406f90f8de" returned: 0 in 0.132s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-quobyte-812d6aa1-c795-4cc4-a007-b4406f90f8de" released by "_delete_snapshot" :: held 1.987s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-quobyte-43b36db4-165e-434f-b15a-bcfff3cf7458" released by "delete_snapshot" :: held 2.012s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:44 devstack cinder-volume[83041]: WARNING cinder.quota [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:36:44 devstack cinder-volume[83041]: DEBUG cinder.quota [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Created reservations ['4ac5ef33-5a30-44d7-80e3-5b035666c25a', '0d5dc10c-c3e6-42ac-b0b5-96b2a3bda907', '847e3d55-9f30-4f5f-990d-3258d356e62d', '0f8aa4a7-d030-4a26-8382-3894b0a3c9e5'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Delete snapshot completed successfully. Sep 16 01:36:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-c0819634-6e8c-474b-8ad1-8b3415f2480a req-7c34e1c6-ce65-4523-8d89-eeaf0bfc3639 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-812d6aa1-c795-4cc4-a007-b4406f90f8de-delete_snapshot" released by "delete_snapshot" :: held 2.710s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "cinder-43b36db4-165e-434f-b15a-bcfff3cf7458-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-43b36db4-165e-434f-b15a-bcfff3cf7458-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:45 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:36:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "cinder-quobyte-43b36db4-165e-434f-b15a-bcfff3cf7458" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:36:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-quobyte-43b36db4-165e-434f-b15a-bcfff3cf7458" acquired by "delete_volume" :: waited 0.033s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:36:45 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[721f0c66-b984-4131-b950-f390c4aabe53]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:36:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458" returned: 0 in 0.870s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-43b36db4-165e-434f-b15a-bcfff3cf7458" returned: 0 in 0.162s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:46 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-quobyte-43b36db4-165e-434f-b15a-bcfff3cf7458" released by "delete_volume" :: held 1.412s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG cinder.quota [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Created reservations ['d1eb14f5-29a0-49c8-bae8-dfc99e57b354', 'dde3cf47-0c0e-4ea9-9089-93b46180f59a', 'de6e1411-29ad-4c9c-8051-f70910860939', '3e673fb5-65f1-4483-b9ea-7effb07bb811'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.294s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:36:47 devstack cinder-volume[83041]: DEBUG cinder.manager [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:36:47 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Deleted volume successfully. Sep 16 01:36:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-9e937881-0ead-4f81-9141-9b7c765e53b5 req-81df1dc1-0542-4ae6-9a01-7d60c6b5ea38 tempest-VolumesSnapshotsTestJSON-1847167267 None] Lock "cinder-43b36db4-165e-434f-b15a-bcfff3cf7458-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:36:57 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=58,cinder:UPDATE=78,cinder:DELETE=6,cinder:INSERT=21 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:36:58 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=55,cinder:INSERT=19,cinder:UPDATE=84,cinder:DELETE=5 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:37:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:37:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:37:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:37:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.537s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:37:04 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-04fa1afe-361e-4717-8161-1e204667583b tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:04 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-04fa1afe-361e-4717-8161-1e204667583b tempest-GroupsTest-1434869407 None] Group tempest-Group1-624117857: creating Sep 16 01:37:04 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-04fa1afe-361e-4717-8161-1e204667583b tempest-GroupsTest-1434869407 None] Group tempest-Group1-624117857: created successfully Sep 16 01:37:04 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-04fa1afe-361e-4717-8161-1e204667583b tempest-GroupsTest-1434869407 None] Create group completed successfully. Sep 16 01:37:05 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d2a4a826-0baa-4daf-be7c-6f7e45f3e090 tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:05 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d2a4a826-0baa-4daf-be7c-6f7e45f3e090 tempest-GroupsTest-1434869407 None] Group tempest-Group2-1449543128: creating Sep 16 01:37:05 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d2a4a826-0baa-4daf-be7c-6f7e45f3e090 tempest-GroupsTest-1434869407 None] Group tempest-Group2-1449543128: created successfully Sep 16 01:37:05 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d2a4a826-0baa-4daf-be7c-6f7e45f3e090 tempest-GroupsTest-1434869407 None] Create group completed successfully. Sep 16 01:37:07 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Flow 'volume_create_manager' (ba855f1b-722d-4ebf-9564-1c1769018899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad5e706-c012-4b05-83a5-5bc8382f84c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad5e706-c012-4b05-83a5-5bc8382f84c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1923950108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a56be806-4fe8-4809-94d1-8ac1a07bc931,host='devstack@QuobyteHD#QuobyteHD',id=1bc3911b-3086-4391-ad4b-43f00d46fdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821caf3e2aea4d86b0453add79d7dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:37:07Z,use_quota=True,user_id='e60e34836a924374b30a37c75d6ca20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5cad6ef-57b7-481c-a82d-02b8448fd51d),volume_type_id=c5cad6ef-57b7-481c-a82d-02b8448fd51d)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431a1fc2-3799-4069-a7da-3366f1757beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (431a1fc2-3799-4069-a7da-3366f1757beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f80619-1e8b-47a9-acec-f564f018b34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82f80619-1e8b-47a9-acec-f564f018b34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc3911b-3086-4391-ad4b-43f00d46fdd8', 'volume_name': 'volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110a19b2-d9d7-4d1f-8db3-702963889f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (110a19b2-d9d7-4d1f-8db3-702963889f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5f2ec7-be83-40f6-8989-6fb96c3a0153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:07 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Volume 1bc3911b-3086-4391-ad4b-43f00d46fdd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8', 'volume_size': 1} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a56be806-4fe8-4809-94d1-8ac1a07bc931,created_at=2025-09-15T23:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1923950108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a56be806-4fe8-4809-94d1-8ac1a07bc931,host='devstack@QuobyteHD#QuobyteHD',id=1bc3911b-3086-4391-ad4b-43f00d46fdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821caf3e2aea4d86b0453add79d7dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:37:07Z,use_quota=True,user_id='e60e34836a924374b30a37c75d6ca20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c5cad6ef-57b7-481c-a82d-02b8448fd51d),volume_type_id=c5cad6ef-57b7-481c-a82d-02b8448fd51d)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Creating volume 1bc3911b-3086-4391-ad4b-43f00d46fdd8 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:37:07 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:37:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:07 devstack quobyte-client[83066]: System call of process 90083 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:37:07 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=18, name=volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8 1073741824" returned: 0 in 0.416s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8" returned: 0 in 0.119s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] <== create_volume: return (652ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f5f2ec7-be83-40f6-8989-6fb96c3a0153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e403ea-965c-4605-ae23-76643ada5c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:08 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Volume volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8 (1bc3911b-3086-4391-ad4b-43f00d46fdd8): created successfully Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e403ea-965c-4605-ae23-76643ada5c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Flow 'volume_create_manager' (ba855f1b-722d-4ebf-9564-1c1769018899) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:37:08 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0c5a4d41-0c76-44cf-a721-2d2b886df989 tempest-GroupsTest-1434869407 None] Created volume successfully. Sep 16 01:37:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Acquiring lock "cinder-quobyte-1bc3911b-3086-4391-ad4b-43f00d46fdd8" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:37:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Lock "cinder-quobyte-1bc3911b-3086-4391-ad4b-43f00d46fdd8" acquired by "delete_volume" :: waited 0.078s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:37:11 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[483fdf15-b979-49ff-9712-eadab5da0e01]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:37:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8" returned: 0 in 0.807s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1bc3911b-3086-4391-ad4b-43f00d46fdd8" returned: 0 in 0.278s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Lock "cinder-quobyte-1bc3911b-3086-4391-ad4b-43f00d46fdd8" released by "delete_volume" :: held 1.495s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Created reservations ['d7ecbad9-5814-4b41-bf87-ee100e1132c8'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:37:14 devstack cinder-volume[83041]: WARNING cinder.quota [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1397374204 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1397374204, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:37:14 devstack cinder-volume[83041]: WARNING cinder.quota [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1397374204 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1397374204, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Created reservations ['eee74d36-9b91-4328-85ac-e7852d3f1f6a', '8a5f596c-0327-47f4-95b8-de0e61b75560', '57d865b9-2121-41d1-938a-e84839928973', '19bff31d-d0ba-42d1-9c60-80aa60a6a9f8'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.099s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:14 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:37:14 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5db5ca70-16ca-433c-85bf-d8be99c2b2ab tempest-GroupsTest-1434869407 None] Delete group completed successfully. Sep 16 01:37:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:15 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Created reservations ['4df47850-0573-4c06-b672-4a39de6c430f'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:37:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:37:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:37:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.127s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:16 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:37:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f38381f6-534e-45d8-a982-56bfcee923e8 tempest-GroupsTest-1434869407 None] Delete group completed successfully. Sep 16 01:37:17 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2fc2bfdb-79e9-4bae-b92e-3eec3d2bef8e tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:17 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2fc2bfdb-79e9-4bae-b92e-3eec3d2bef8e tempest-GroupsTest-1434869407 None] Group tempest-GroupsTest-Group-564268564: creating Sep 16 01:37:17 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2fc2bfdb-79e9-4bae-b92e-3eec3d2bef8e tempest-GroupsTest-1434869407 None] Group tempest-GroupsTest-Group-564268564: created successfully Sep 16 01:37:17 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2fc2bfdb-79e9-4bae-b92e-3eec3d2bef8e tempest-GroupsTest-1434869407 None] Create group completed successfully. Sep 16 01:37:18 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:18 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:37:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Flow 'volume_create_manager' (d244e1af-2b67-4ce2-bdb3-b46a658a2bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098f7434-ea7e-4315-8a37-313ca72cd499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (098f7434-ea7e-4315-8a37-313ca72cd499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1557942800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94b61c4f-9a3f-4026-9fd7-93d5539d2ec2,host='devstack@QuobyteHD#QuobyteHD',id=ea21ee14-907d-4c56-8d37-0968a4c2a400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821caf3e2aea4d86b0453add79d7dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:37:19Z,use_quota=True,user_id='e60e34836a924374b30a37c75d6ca20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d3f1df4-8917-42a0-a1a7-783fb4b42fb7),volume_type_id=5d3f1df4-8917-42a0-a1a7-783fb4b42fb7)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60169dbc-81b2-41c5-9d6f-054077eacd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60169dbc-81b2-41c5-9d6f-054077eacd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60927ef-3018-4467-83a2-b69a2037b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60927ef-3018-4467-83a2-b69a2037b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea21ee14-907d-4c56-8d37-0968a4c2a400', 'volume_name': 'volume-ea21ee14-907d-4c56-8d37-0968a4c2a400', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817b2e39-5fa3-4e81-9db9-9d2ce06ff9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (817b2e39-5fa3-4e81-9db9-9d2ce06ff9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c015ec7b-b1cd-48d8-8996-a9e773093505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:19 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Volume ea21ee14-907d-4c56-8d37-0968a4c2a400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea21ee14-907d-4c56-8d37-0968a4c2a400', 'volume_size': 1} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94b61c4f-9a3f-4026-9fd7-93d5539d2ec2,created_at=2025-09-15T23:37:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1557942800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94b61c4f-9a3f-4026-9fd7-93d5539d2ec2,host='devstack@QuobyteHD#QuobyteHD',id=ea21ee14-907d-4c56-8d37-0968a4c2a400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821caf3e2aea4d86b0453add79d7dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:37:19Z,use_quota=True,user_id='e60e34836a924374b30a37c75d6ca20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d3f1df4-8917-42a0-a1a7-783fb4b42fb7),volume_type_id=5d3f1df4-8917-42a0-a1a7-783fb4b42fb7)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Creating volume ea21ee14-907d-4c56-8d37-0968a4c2a400 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:37:19 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ea21ee14-907d-4c56-8d37-0968a4c2a400 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:19 devstack quobyte-client[83066]: System call of process 90155 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:37:19 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=19, name=volume-ea21ee14-907d-4c56-8d37-0968a4c2a400, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ea21ee14-907d-4c56-8d37-0968a4c2a400 1073741824" returned: 0 in 0.568s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ea21ee14-907d-4c56-8d37-0968a4c2a400 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ea21ee14-907d-4c56-8d37-0968a4c2a400" returned: 0 in 0.324s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] <== create_volume: return (1089ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:37:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c015ec7b-b1cd-48d8-8996-a9e773093505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea21ee14-907d-4c56-8d37-0968a4c2a400', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf62d98-c3a1-46d8-9764-fa40f7718d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:21 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Volume volume-ea21ee14-907d-4c56-8d37-0968a4c2a400 (ea21ee14-907d-4c56-8d37-0968a4c2a400): created successfully Sep 16 01:37:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf62d98-c3a1-46d8-9764-fa40f7718d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Flow 'volume_create_manager' (d244e1af-2b67-4ce2-bdb3-b46a658a2bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:37:21 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d05bf597-90ab-4519-83df-131f2ff5b119 tempest-GroupsTest-1434869407 None] Created volume successfully. Sep 16 01:37:23 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:23 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Flow 'volume_create_manager' (5e1c5b99-d454-49ff-8aa6-3590c49b9d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4dba37-fd4e-4d0e-a17f-3213b6503910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4dba37-fd4e-4d0e-a17f-3213b6503910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-305426469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94b61c4f-9a3f-4026-9fd7-93d5539d2ec2,host='devstack@QuobyteHD#QuobyteHD',id=2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821caf3e2aea4d86b0453add79d7dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:37:24Z,use_quota=True,user_id='e60e34836a924374b30a37c75d6ca20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d3f1df4-8917-42a0-a1a7-783fb4b42fb7),volume_type_id=5d3f1df4-8917-42a0-a1a7-783fb4b42fb7)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03654db-11cb-4673-a948-6dc7c34377f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f03654db-11cb-4673-a948-6dc7c34377f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dae062-4b4f-40d2-9986-dba02221899a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82dae062-4b4f-40d2-9986-dba02221899a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65', 'volume_name': 'volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a6b9ab-f614-4966-86f2-cb5ac748cfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4a6b9ab-f614-4966-86f2-cb5ac748cfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a6c2bf-d66c-4139-87f5-cd3fdc909198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:24 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Volume 2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65', 'volume_size': 1} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.016s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94b61c4f-9a3f-4026-9fd7-93d5539d2ec2,created_at=2025-09-15T23:37:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-305426469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94b61c4f-9a3f-4026-9fd7-93d5539d2ec2,host='devstack@QuobyteHD#QuobyteHD',id=2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='821caf3e2aea4d86b0453add79d7dbf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:37:24Z,use_quota=True,user_id='e60e34836a924374b30a37c75d6ca20e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5d3f1df4-8917-42a0-a1a7-783fb4b42fb7),volume_type_id=5d3f1df4-8917-42a0-a1a7-783fb4b42fb7)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Creating volume 2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:37:24 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:37:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:25 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=20, name=volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:37:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65 1073741824" returned: 0 in 0.795s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65" returned: 0 in 0.354s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] <== create_volume: return (1751ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:37:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a6c2bf-d66c-4139-87f5-cd3fdc909198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e50d1d-0df2-42a3-8d81-baf3a571a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:37:27 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Volume volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65 (2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65): created successfully Sep 16 01:37:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e50d1d-0df2-42a3-8d81-baf3a571a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:37:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Flow 'volume_create_manager' (5e1c5b99-d454-49ff-8aa6-3590c49b9d41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:37:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-08536919-a0bc-4508-8954-d8b93a26edd9 tempest-GroupsTest-1434869407 None] Created volume successfully. Sep 16 01:37:29 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-bf1c2263-f9b1-45b7-8502-f2f102b6df2b tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:30 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bf1c2263-f9b1-45b7-8502-f2f102b6df2b tempest-GroupsTest-1434869407 None] Update group completed successfully. Sep 16 01:37:31 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-66a709f6-83c5-4506-a877-5b05cbbe3761 tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-66a709f6-83c5-4506-a877-5b05cbbe3761 tempest-GroupsTest-1434869407 None] Update group completed successfully. Sep 16 01:37:34 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:37:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Acquiring lock "cinder-quobyte-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:37:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Lock "cinder-quobyte-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65" acquired by "delete_volume" :: waited 0.183s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:37:34 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf469b9a-8761-40a6-8260-d9abe3c654f8]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:37:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65" returned: 0 in 0.937s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65" returned: 0 in 0.257s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Lock "cinder-quobyte-2a7cdf02-1ba6-4a06-8b3d-ff1e80538a65" released by "delete_volume" :: held 1.558s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:37:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Acquiring lock "cinder-quobyte-ea21ee14-907d-4c56-8d37-0968a4c2a400" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:37:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Lock "cinder-quobyte-ea21ee14-907d-4c56-8d37-0968a4c2a400" acquired by "delete_volume" :: waited 0.043s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:37:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ede2d-68d5-46a9-946c-978196320575]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:37:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ea21ee14-907d-4c56-8d37-0968a4c2a400 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ea21ee14-907d-4c56-8d37-0968a4c2a400" returned: 0 in 1.335s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ea21ee14-907d-4c56-8d37-0968a4c2a400 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ea21ee14-907d-4c56-8d37-0968a4c2a400" returned: 0 in 0.228s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Lock "cinder-quobyte-ea21ee14-907d-4c56-8d37-0968a4c2a400" released by "delete_volume" :: held 1.922s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:37:38 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Created reservations ['352773af-7b81-4c7f-af59-7868f9304a0e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:37:38 devstack cinder-volume[83041]: WARNING cinder.quota [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-732127642 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-732127642, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:37:38 devstack cinder-volume[83041]: WARNING cinder.quota [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-732127642 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-732127642, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:37:38 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Created reservations ['1589801e-b53c-4c99-ba87-18595f98394f', 'a262a175-8994-418f-8e02-86d22b26fa2e', '1fc6832c-4c5d-4930-8708-202074976e39', 'd38395ec-7f97-476c-bdfc-899d7f03f598'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Created reservations ['2945bf22-0661-4138-9c9f-91c6c87d8b96', '7c2ccaf3-9f87-471b-906e-4cf4ccb32cfa', '6b97f65a-2d94-4459-b0d6-37b57f72e255', 'eeb3c3ca-43a7-4be4-b9f7-25788e4d8d55'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.199s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:37:39 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:37:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-743870a7-31a3-453b-9210-5c238ee5251d tempest-GroupsTest-1434869407 None] Delete group completed successfully. Sep 16 01:37:49 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=34,cinder:UPDATE=52,cinder:INSERT=7,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:37:49 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=46,cinder:UPDATE=33,cinder:DELETE=2,cinder:INSERT=8 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:38:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:38:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:38:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:38:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.072s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 1.742s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:38:14 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:38:15 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:38:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:41 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Flow 'volume_create_manager' (90f1e36d-7c01-449a-8fb4-45640ab4cabe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad080553-89d7-4f21-8bd9-9631b8cedf7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad080553-89d7-4f21-8bd9-9631b8cedf7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1036620508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cf93d2-8665-4637-8f67-1b384e6582e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ca1334f89942edb22a9797a8531363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:41Z,use_quota=True,user_id='f337929336f646d59852c98f852b53e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21284c6c-3123-4c58-9c8f-82a185dd5419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21284c6c-3123-4c58-9c8f-82a185dd5419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d870fcdf-1344-47d8-8b3c-4cb8298c1853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d870fcdf-1344-47d8-8b3c-4cb8298c1853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97cf93d2-8665-4637-8f67-1b384e6582e8', 'volume_name': 'volume-97cf93d2-8665-4637-8f67-1b384e6582e8', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354ad9c8-fc91-4def-956e-60cd627716ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (354ad9c8-fc91-4def-956e-60cd627716ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15286018-8d23-4017-b222-9a965ac57b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:42 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume 97cf93d2-8665-4637-8f67-1b384e6582e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97cf93d2-8665-4637-8f67-1b384e6582e8', 'volume_size': 1} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1036620508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cf93d2-8665-4637-8f67-1b384e6582e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ca1334f89942edb22a9797a8531363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:41Z,use_quota=True,user_id='f337929336f646d59852c98f852b53e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Creating volume 97cf93d2-8665-4637-8f67-1b384e6582e8 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:38:42 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-97cf93d2-8665-4637-8f67-1b384e6582e8 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:42 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=21, name=volume-97cf93d2-8665-4637-8f67-1b384e6582e8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-97cf93d2-8665-4637-8f67-1b384e6582e8 1073741824" returned: 0 in 0.464s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-97cf93d2-8665-4637-8f67-1b384e6582e8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-97cf93d2-8665-4637-8f67-1b384e6582e8" returned: 0 in 0.167s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] <== create_volume: return (739ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:38:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15286018-8d23-4017-b222-9a965ac57b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cf93d2-8665-4637-8f67-1b384e6582e8', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289e91bd-7aef-4e70-8042-2c910e680618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:43 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume volume-97cf93d2-8665-4637-8f67-1b384e6582e8 (97cf93d2-8665-4637-8f67-1b384e6582e8): created successfully Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (289e91bd-7aef-4e70-8042-2c910e680618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Flow 'volume_create_manager' (90f1e36d-7c01-449a-8fb4-45640ab4cabe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:43 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-23786798-d345-465c-be9e-747d4b3d25a2 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Created volume successfully. Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Acquiring lock "cinder-97cf93d2-8665-4637-8f67-1b384e6582e8-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "cinder-97cf93d2-8665-4637-8f67-1b384e6582e8-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:38:43 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Acquiring lock "cinder-quobyte-97cf93d2-8665-4637-8f67-1b384e6582e8" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "cinder-quobyte-97cf93d2-8665-4637-8f67-1b384e6582e8" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[78456a76-2331-41b6-882f-ee02ac615699]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:38:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-97cf93d2-8665-4637-8f67-1b384e6582e8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-97cf93d2-8665-4637-8f67-1b384e6582e8" returned: 0 in 0.550s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-97cf93d2-8665-4637-8f67-1b384e6582e8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-97cf93d2-8665-4637-8f67-1b384e6582e8" returned: 0 in 0.082s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "cinder-quobyte-97cf93d2-8665-4637-8f67-1b384e6582e8" released by "delete_volume" :: held 0.766s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:38:44 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Created reservations ['26a29f2b-7ac4-478a-89cf-572cba743bdf', '774d2dd0-053e-44b4-afd8-c2aeaddb1a36', 'a533135e-bc86-44f9-a5db-67854bc2ef1c', '97b76970-e569-4dc6-a523-311356160614'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.091s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:38:45 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Deleted volume successfully. Sep 16 01:38:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6e51e832-5f38-4cfb-a745-4b9f851bdfb5 tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "cinder-97cf93d2-8665-4637-8f67-1b384e6582e8-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:38:46 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Flow 'volume_create_manager' (a382f063-f2de-4244-87bb-76a634958215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb0982c-e5bc-41e8-88ac-bffa0772e3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb0982c-e5bc-41e8-88ac-bffa0772e3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-953840188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39c1a3b-d521-429d-b91c-19e89788a5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23d266accd84b42b2caf540c11f8e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:46Z,use_quota=True,user_id='6345a7280ae64336869ff0e1c8a79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c5d9c6-d40a-4e1f-a7a1-b0a492de3a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c5d9c6-d40a-4e1f-a7a1-b0a492de3a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f53b3dd-ac22-44e5-8adb-8199488ded59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f53b3dd-ac22-44e5-8adb-8199488ded59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b39c1a3b-d521-429d-b91c-19e89788a5ae', 'volume_name': 'volume-b39c1a3b-d521-429d-b91c-19e89788a5ae', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3d376d-f702-4147-ac48-b560a03126f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e3d376d-f702-4147-ac48-b560a03126f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9846930d-8f24-4026-9e1b-5cdb205e53e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:46 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Volume b39c1a3b-d521-429d-b91c-19e89788a5ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b39c1a3b-d521-429d-b91c-19e89788a5ae', 'volume_size': 1} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-953840188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b39c1a3b-d521-429d-b91c-19e89788a5ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23d266accd84b42b2caf540c11f8e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:46Z,use_quota=True,user_id='6345a7280ae64336869ff0e1c8a79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Creating volume b39c1a3b-d521-429d-b91c-19e89788a5ae {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:38:46 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:38:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:46 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=22, name=volume-b39c1a3b-d521-429d-b91c-19e89788a5ae, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:38:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae 1073741824" returned: 0 in 0.896s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:47 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:38:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Flow 'volume_create_manager' (98224bb6-744e-4c26-aaea-884fa5683fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1878c72f-3c7a-4728-aef7-0203039f5035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1878c72f-3c7a-4728-aef7-0203039f5035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1546261105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d59f7c-815a-490d-bb5a-3dc3fda0c980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ca1334f89942edb22a9797a8531363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:47Z,use_quota=True,user_id='f337929336f646d59852c98f852b53e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7576ac-2574-4750-a4ce-2a41c075ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7576ac-2574-4750-a4ce-2a41c075ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8704ab87-c4a8-497b-a61b-ddc893373854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8704ab87-c4a8-497b-a61b-ddc893373854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6d59f7c-815a-490d-bb5a-3dc3fda0c980', 'volume_name': 'volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee57f9cb-f9c5-4b24-be86-d2468b12f3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee57f9cb-f9c5-4b24-be86-d2468b12f3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73316f2c-f8b9-42b7-8804-363f3a119da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:48 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume e6d59f7c-815a-490d-bb5a-3dc3fda0c980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980', 'volume_size': 1} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae" returned: 0 in 0.619s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] <== create_volume: return (1557ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.566s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1546261105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d59f7c-815a-490d-bb5a-3dc3fda0c980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ca1334f89942edb22a9797a8531363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:47Z,use_quota=True,user_id='f337929336f646d59852c98f852b53e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Creating volume e6d59f7c-815a-490d-bb5a-3dc3fda0c980 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:38:48 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:48 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=23, name=volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9846930d-8f24-4026-9e1b-5cdb205e53e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b39c1a3b-d521-429d-b91c-19e89788a5ae', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb02c25-961b-4b22-b4b4-96825b17502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980 1073741824" returned: 0 in 0.563s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:49 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Volume volume-b39c1a3b-d521-429d-b91c-19e89788a5ae (b39c1a3b-d521-429d-b91c-19e89788a5ae): created successfully Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb02c25-961b-4b22-b4b4-96825b17502c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Flow 'volume_create_manager' (a382f063-f2de-4244-87bb-76a634958215) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:49 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Flow 'volume_create_manager' (ff991f39-ff0c-4269-b96c-459c1c898523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5887b8cb-d32e-4d4f-b2e1-30516dd383ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980" returned: 0 in 0.594s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] <== create_volume: return (1271ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.286s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5887b8cb-d32e-4d4f-b2e1-30516dd383ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2069686749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c3d849-42fd-420d-b5ca-25c73c2817f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709cce5ae9db4a0bb0cdd33a8e9f7ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:48Z,use_quota=True,user_id='238d41fff2874b8aba7eb3bad159a567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c249966-051a-4010-b4ed-8e09685ae5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c249966-051a-4010-b4ed-8e09685ae5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d45603f-f42e-4d25-abf4-861a4005f3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d45603f-f42e-4d25-abf4-861a4005f3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c3d849-42fd-420d-b5ca-25c73c2817f6', 'volume_name': 'volume-17c3d849-42fd-420d-b5ca-25c73c2817f6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dfa8fb-8108-4400-a89b-8ef5ff5c34cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2dfa8fb-8108-4400-a89b-8ef5ff5c34cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37eccdfb-faf0-4ac4-9a07-f2f728c18011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:49 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Volume 17c3d849-42fd-420d-b5ca-25c73c2817f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c3d849-42fd-420d-b5ca-25c73c2817f6', 'volume_size': 1} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2069686749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c3d849-42fd-420d-b5ca-25c73c2817f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709cce5ae9db4a0bb0cdd33a8e9f7ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:48Z,use_quota=True,user_id='238d41fff2874b8aba7eb3bad159a567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Creating volume 17c3d849-42fd-420d-b5ca-25c73c2817f6 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:38:49 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-17c3d849-42fd-420d-b5ca-25c73c2817f6 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:49 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ecea2ddf-db0b-4ff7-9a18-92c8959a7613 tempest-AttachVolumeNegativeTest-678661232 None] Created volume successfully. Sep 16 01:38:49 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=24, name=volume-17c3d849-42fd-420d-b5ca-25c73c2817f6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73316f2c-f8b9-42b7-8804-363f3a119da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0508c95a-f8d7-4c17-960f-9d2e9af3b941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:50 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Volume volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980 (e6d59f7c-815a-490d-bb5a-3dc3fda0c980): created successfully Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0508c95a-f8d7-4c17-960f-9d2e9af3b941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Flow 'volume_create_manager' (98224bb6-744e-4c26-aaea-884fa5683fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bbcb4f64-2461-4bad-b601-2612675054cf tempest-VolumeQuotasAdminTestJSON-1560105397 None] Created volume successfully. Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-17c3d849-42fd-420d-b5ca-25c73c2817f6 1073741824" returned: 0 in 0.726s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-17c3d849-42fd-420d-b5ca-25c73c2817f6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-17c3d849-42fd-420d-b5ca-25c73c2817f6" returned: 0 in 0.372s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] <== create_volume: return (1262ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.283s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37eccdfb-faf0-4ac4-9a07-f2f728c18011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c3d849-42fd-420d-b5ca-25c73c2817f6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc59bcc9-215d-40a8-b0f9-c352c45e67b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:51 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Volume volume-17c3d849-42fd-420d-b5ca-25c73c2817f6 (17c3d849-42fd-420d-b5ca-25c73c2817f6): created successfully Sep 16 01:38:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc59bcc9-215d-40a8-b0f9-c352c45e67b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Flow 'volume_create_manager' (ff991f39-ff0c-4269-b96c-459c1c898523) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:51 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-fcbd0f8a-e365-455a-b79b-d5285c8ff474 tempest-ServersNegativeTestJSON-979132604 None] Created volume successfully. Sep 16 01:38:51 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-750448a2-5f44-4a56-93a4-09cf21b7768e tempest-VolumeQuotasAdminTestJSON-724404608 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:51 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-750448a2-5f44-4a56-93a4-09cf21b7768e tempest-VolumeQuotasAdminTestJSON-724404608 None] Transfer volume completed successfully. Sep 16 01:38:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Acquiring lock "cinder-e6d59f7c-815a-490d-bb5a-3dc3fda0c980-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:38:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Lock "cinder-e6d59f7c-815a-490d-bb5a-3dc3fda0c980-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:38:52 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Acquiring lock "cinder-quobyte-e6d59f7c-815a-490d-bb5a-3dc3fda0c980" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:38:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Lock "cinder-quobyte-e6d59f7c-815a-490d-bb5a-3dc3fda0c980" acquired by "delete_volume" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:38:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e8b265-2ad6-4654-ac82-e29b4910f6e5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:38:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980" returned: 0 in 0.934s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e2ed3841-edb4-48f4-862c-c3afb46582a3 req-c3fa8a31-703a-45af-b299-2628511c3d1a tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e2ed3841-edb4-48f4-862c-c3afb46582a3 req-c3fa8a31-703a-45af-b299-2628511c3d1a tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6d59f7c-815a-490d-bb5a-3dc3fda0c980" returned: 0 in 0.680s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:54 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[8649d095-dfb8-48f6-a4af-2139b69c2f36]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:38:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e2ed3841-edb4-48f4-862c-c3afb46582a3 req-c3fa8a31-703a-45af-b299-2628511c3d1a tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:54 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:54 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Flow 'volume_create_manager' (f98f18b4-7177-4c4b-af98-736ef3265deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61831e0d-2504-47db-9402-f2ff9855c0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Lock "cinder-quobyte-e6d59f7c-815a-490d-bb5a-3dc3fda0c980" released by "delete_volume" :: held 2.429s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61831e0d-2504-47db-9402-f2ff9855c0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1640209964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595a850b-077a-4314-9b5c-b2013c536654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709cce5ae9db4a0bb0cdd33a8e9f7ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:54Z,use_quota=True,user_id='238d41fff2874b8aba7eb3bad159a567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f25b8e-e650-4ca4-ad5c-e1eac1e2540a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f25b8e-e650-4ca4-ad5c-e1eac1e2540a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab63d1bf-d2ff-4ec1-85dd-7e990829d684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab63d1bf-d2ff-4ec1-85dd-7e990829d684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '595a850b-077a-4314-9b5c-b2013c536654', 'volume_name': 'volume-595a850b-077a-4314-9b5c-b2013c536654', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe6de3b-82d8-4c66-a7b6-42529487b0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe6de3b-82d8-4c66-a7b6-42529487b0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571420e6-d89d-473c-b465-f20d3645cd4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:55 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Volume 595a850b-077a-4314-9b5c-b2013c536654: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-595a850b-077a-4314-9b5c-b2013c536654', 'volume_size': 1} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e2ed3841-edb4-48f4-862c-c3afb46582a3 req-c3fa8a31-703a-45af-b299-2628511c3d1a tempest-AttachVolumeNegativeTest-678661232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae" returned: 0 in 0.709s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e2ed3841-edb4-48f4-862c-c3afb46582a3 req-c3fa8a31-703a-45af-b299-2628511c3d1a tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.761s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1640209964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595a850b-077a-4314-9b5c-b2013c536654,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='709cce5ae9db4a0bb0cdd33a8e9f7ad0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:38:54Z,use_quota=True,user_id='238d41fff2874b8aba7eb3bad159a567',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Creating volume 595a850b-077a-4314-9b5c-b2013c536654 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:38:55 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:38:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-595a850b-077a-4314-9b5c-b2013c536654 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:55 devstack quobyte-client[83066]: System call of process 90659 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:38:55 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=25, name=volume-595a850b-077a-4314-9b5c-b2013c536654, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e2ed3841-edb4-48f4-862c-c3afb46582a3 req-c3fa8a31-703a-45af-b299-2628511c3d1a tempest-AttachVolumeNegativeTest-678661232 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-b39c1a3b-d521-429d-b91c-19e89788a5ae', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8e069bf6-b77a-43d7-b029-8bfc73ebd4d6', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:38:56 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-e2ed3841-edb4-48f4-862c-c3afb46582a3 req-c3fa8a31-703a-45af-b299-2628511c3d1a tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-595a850b-077a-4314-9b5c-b2013c536654 1073741824" returned: 0 in 0.545s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-595a850b-077a-4314-9b5c-b2013c536654 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Created reservations ['430da6d6-a372-4024-a919-6ca185f03097', 'da63fa33-221b-4f6d-892f-ff256cf9d946', '427b2c00-7c4f-4929-98d5-affa8e058866', '6d152f41-3ad0-412f-a01a-e894e88e7403'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-595a850b-077a-4314-9b5c-b2013c536654" returned: 0 in 0.434s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] <== create_volume: return (1006ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571420e6-d89d-473c-b465-f20d3645cd4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595a850b-077a-4314-9b5c-b2013c536654', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a4b80b-b1c6-4522-8963-80eeee4e9407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:38:56 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Volume volume-595a850b-077a-4314-9b5c-b2013c536654 (595a850b-077a-4314-9b5c-b2013c536654): created successfully Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a4b80b-b1c6-4522-8963-80eeee4e9407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Flow 'volume_create_manager' (f98f18b4-7177-4c4b-af98-736ef3265deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:38:56 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-e2ed3841-edb4-48f4-862c-c3afb46582a3 req-c3fa8a31-703a-45af-b299-2628511c3d1a tempest-AttachVolumeNegativeTest-678661232 None] attachment_update completed successfully. Sep 16 01:38:56 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f0379ebd-65b4-4e82-8164-94330eea94f6 tempest-ServersNegativeTestJSON-979132604 None] Created volume successfully. Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.113s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:56 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:38:57 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Deleted volume successfully. Sep 16 01:38:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-74c50573-d6e0-488f-8445-75a584f58862 tempest-VolumeQuotasAdminTestJSON-436247116 None] Lock "cinder-e6d59f7c-815a-490d-bb5a-3dc3fda0c980-delete_volume" released by "delete_volume" :: held 4.451s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:38:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "cinder-595a850b-077a-4314-9b5c-b2013c536654-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:38:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Lock "cinder-595a850b-077a-4314-9b5c-b2013c536654-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:38:58 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:38:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "cinder-quobyte-595a850b-077a-4314-9b5c-b2013c536654" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:38:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Lock "cinder-quobyte-595a850b-077a-4314-9b5c-b2013c536654" acquired by "delete_volume" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:38:58 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c54597-e1f3-4c1f-a7d4-6eef14df3b0b]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:38:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-595a850b-077a-4314-9b5c-b2013c536654 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:38:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-595a850b-077a-4314-9b5c-b2013c536654" returned: 0 in 0.835s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:38:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-595a850b-077a-4314-9b5c-b2013c536654 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-595a850b-077a-4314-9b5c-b2013c536654" returned: 0 in 0.333s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Lock "cinder-quobyte-595a850b-077a-4314-9b5c-b2013c536654" released by "delete_volume" :: held 1.652s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:00 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Created reservations ['068c8eb7-e2dd-4165-ad61-5e1469fd5e95', '611f4fc9-1a9f-4c8d-a322-1a376bd51ffa', '0146b118-d552-4642-af66-cb71cf1d2e88', '91df185c-a2ab-4395-b4fc-ea6ea823303a'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:39:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.209s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:01 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:39:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Deleted volume successfully. Sep 16 01:39:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-531ebba8-4700-4a65-bbff-4d3501454042 tempest-ServersNegativeTestJSON-979132604 None] Lock "cinder-595a850b-077a-4314-9b5c-b2013c536654-delete_volume" released by "delete_volume" :: held 3.422s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "cinder-17c3d849-42fd-420d-b5ca-25c73c2817f6-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Lock "cinder-17c3d849-42fd-420d-b5ca-25c73c2817f6-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:02 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "cinder-quobyte-17c3d849-42fd-420d-b5ca-25c73c2817f6" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Lock "cinder-quobyte-17c3d849-42fd-420d-b5ca-25c73c2817f6" acquired by "delete_volume" :: waited 0.036s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:02 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0829db-4c08-4ae8-b9e1-e4a22d723a4a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:39:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-17c3d849-42fd-420d-b5ca-25c73c2817f6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-17c3d849-42fd-420d-b5ca-25c73c2817f6" returned: 0 in 0.462s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-17c3d849-42fd-420d-b5ca-25c73c2817f6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-17c3d849-42fd-420d-b5ca-25c73c2817f6" returned: 0 in 0.127s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Lock "cinder-quobyte-17c3d849-42fd-420d-b5ca-25c73c2817f6" released by "delete_volume" :: held 0.851s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:03 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Created reservations ['b26eb7e3-4a9a-49e6-acbe-d35a6f055424', '9ab61704-19a1-446d-a2fb-fcbd0b4cf9d4', '4b055895-ddc1-4b17-bd92-90e9c36266a4', 'fbbb9150-16a0-412e-8c98-e103bf616ec2'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:39:03 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.486s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.028s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.206s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:39:05 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Deleted volume successfully. Sep 16 01:39:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-37ddb2bb-dbfb-4d2d-955a-994792d9e785 tempest-ServersNegativeTestJSON-979132604 None] Lock "cinder-17c3d849-42fd-420d-b5ca-25c73c2817f6-delete_volume" released by "delete_volume" :: held 3.220s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:39:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Flow 'volume_create_manager' (b0dbc774-bf68-4ba9-b4ba-721f1aca8cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa1a165-98fd-425f-ad18-b26e5b9b4209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3aa1a165-98fd-425f-ad18-b26e5b9b4209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1429478167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bc2f05-3dd1-4437-8bdb-a068eacda056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7387f86046340d9ac3bd87217172af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:11Z,use_quota=True,user_id='bb48ff2d7cc9402292209a7c491d04fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08680de5-c5bc-4c44-b71c-5b68daf519d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08680de5-c5bc-4c44-b71c-5b68daf519d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5234ecd-53df-4266-a019-9562a83db413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5234ecd-53df-4266-a019-9562a83db413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bc2f05-3dd1-4437-8bdb-a068eacda056', 'volume_name': 'volume-45bc2f05-3dd1-4437-8bdb-a068eacda056', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123e0574-08b6-4ae2-99e5-9d38016fad96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123e0574-08b6-4ae2-99e5-9d38016fad96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ae80bb-9b16-450c-bef6-45d5f6e8f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Volume 45bc2f05-3dd1-4437-8bdb-a068eacda056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bc2f05-3dd1-4437-8bdb-a068eacda056', 'volume_size': 1} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1429478167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bc2f05-3dd1-4437-8bdb-a068eacda056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7387f86046340d9ac3bd87217172af7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:11Z,use_quota=True,user_id='bb48ff2d7cc9402292209a7c491d04fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Creating volume 45bc2f05-3dd1-4437-8bdb-a068eacda056 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:39:11 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:11 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=26, name=volume-45bc2f05-3dd1-4437-8bdb-a068eacda056, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 1073741824" returned: 0 in 0.372s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056" returned: 0 in 0.079s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] <== create_volume: return (523ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.536s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75ae80bb-9b16-450c-bef6-45d5f6e8f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bc2f05-3dd1-4437-8bdb-a068eacda056', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03421cb3-903b-49a2-949c-3d73235d32de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Volume volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 (45bc2f05-3dd1-4437-8bdb-a068eacda056): created successfully Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03421cb3-903b-49a2-949c-3d73235d32de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Flow 'volume_create_manager' (b0dbc774-bf68-4ba9-b4ba-721f1aca8cd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:11 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1bcaa472-f96b-4754-b11b-13a460e0e12a tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Created volume successfully. Sep 16 01:39:13 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Creating offline snapshot 09a6c731-f544-440c-ab0c-556f1c19f0af of volume 45bc2f05-3dd1-4437-8bdb-a068eacda056 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:39:13 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d2789b-4f7e-4f03-8046-e0cd1f450fbc]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:39:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056" returned: 0 in 0.450s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:13 devstack quobyte-client[83066]: System call of process 91119 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:13 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=27, name=volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af 1G" returned: 0 in 0.264s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): qemu-img rebase -u -b volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "qemu-img rebase -u -b volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af" returned: 0 in 0.184s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af" returned: 0 in 0.129s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af" returned: 0 in 0.097s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.info" returned: 0 in 0.089s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.info" returned: 0 in 0.084s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.714s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:15 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-df601c90-bac4-4cbd-a400-ab79f7cc2271 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Create snapshot completed successfully Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "cinder-09a6c731-f544-440c-ab0c-556f1c19f0af-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-09a6c731-f544-440c-ab0c-556f1c19f0af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:17 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "cinder-quobyte-45bc2f05-3dd1-4437-8bdb-a068eacda056" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-quobyte-45bc2f05-3dd1-4437-8bdb-a068eacda056" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "cinder-quobyte-09a6c731-f544-440c-ab0c-556f1c19f0af" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-quobyte-09a6c731-f544-440c-ab0c-556f1c19f0af" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Deleting offline snapshot 09a6c731-f544-440c-ab0c-556f1c19f0af of volume 45bc2f05-3dd1-4437-8bdb-a068eacda056 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] snapshot_file for this snap is: volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dd8c5a-f5c4-44be-abcc-8a8d2a690ec9]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:39:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:18 devstack quobyte-client[83066]: System call of process 91201 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af" returned: 0 in 0.934s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45bc2f05-3dd1-4437-8bdb-a068eacda056(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:39:19 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[346a2fda-9a48-4ce0-994a-813501aa2d27]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:39:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056" returned: 0 in 0.896s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:20 devstack quobyte-client[83066]: System call of process 91212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af" returned: 0 in 0.609s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056.09a6c731-f544-440c-ab0c-556f1c19f0af" returned: 0 in 0.240s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-quobyte-09a6c731-f544-440c-ab0c-556f1c19f0af" released by "_delete_snapshot" :: held 3.415s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-quobyte-45bc2f05-3dd1-4437-8bdb-a068eacda056" released by "delete_snapshot" :: held 3.467s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:21 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Created reservations ['fd2d66dd-1755-4c59-a062-268700d809db', '11606086-9306-42c4-9460-532c08f0cd94', 'd224627e-56db-4c1e-b542-e84054c6e083', '969af89a-153e-44eb-8be7-4c4dc67878ea'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:39:21 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Delete snapshot completed successfully. Sep 16 01:39:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-faecedc2-bfc2-4ff7-a8c9-89f9a9c56395 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-09a6c731-f544-440c-ab0c-556f1c19f0af-delete_snapshot" released by "delete_snapshot" :: held 4.157s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "cinder-45bc2f05-3dd1-4437-8bdb-a068eacda056-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-45bc2f05-3dd1-4437-8bdb-a068eacda056-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:22 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "cinder-quobyte-45bc2f05-3dd1-4437-8bdb-a068eacda056" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-quobyte-45bc2f05-3dd1-4437-8bdb-a068eacda056" acquired by "delete_volume" :: waited 0.021s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:22 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[36891790-3e80-49fb-be24-6134703465dc]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:39:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:23 devstack quobyte-client[83066]: System call of process 91226 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056" returned: 0 in 0.779s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45bc2f05-3dd1-4437-8bdb-a068eacda056" returned: 0 in 0.157s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-quobyte-45bc2f05-3dd1-4437-8bdb-a068eacda056" released by "delete_volume" :: held 1.136s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Created reservations ['408ba9c1-c792-4c10-bdb4-e389aca70f15', 'c108ea76-9bb7-45c7-94ea-420f792dea93', 'ab65fe7c-3a51-40a9-8854-3a994385abe9', 'fd21a081-01b6-4401-a820-a658eebe4bcd'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.111s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:39:24 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Deleted volume successfully. Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1f4df404-c57c-4a89-add6-5c9cd5193605 tempest-VolumeSnapshotQuotasNegativeTestJSON-679270973 None] Lock "cinder-45bc2f05-3dd1-4437-8bdb-a068eacda056-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Flow 'volume_create_manager' (7ac3dbfc-67ff-4c72-8e20-c82fd96b4708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb51e4ef-29a0-4da9-8faa-f3373f0a8440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb51e4ef-29a0-4da9-8faa-f3373f0a8440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1286127345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23900fbe-f18a-4c90-968a-8379d940e309,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a067d5c8d8c4fa8ac11cc18c3363d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:25Z,use_quota=True,user_id='8421edc1de314dc8a9216fd6e1c2c80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f073603f-9e6f-483f-9c01-a140dc0d0abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f073603f-9e6f-483f-9c01-a140dc0d0abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390b939e-f02e-4c23-abd5-173de8813411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (390b939e-f02e-4c23-abd5-173de8813411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23900fbe-f18a-4c90-968a-8379d940e309', 'volume_name': 'volume-23900fbe-f18a-4c90-968a-8379d940e309', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f17bda-a054-46e3-b26a-beed1ed79432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f17bda-a054-46e3-b26a-beed1ed79432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a209ae-b730-48e8-aeb9-dd4c085551c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:24 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Volume 23900fbe-f18a-4c90-968a-8379d940e309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23900fbe-f18a-4c90-968a-8379d940e309', 'volume_size': 1} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1286127345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23900fbe-f18a-4c90-968a-8379d940e309,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a067d5c8d8c4fa8ac11cc18c3363d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:25Z,use_quota=True,user_id='8421edc1de314dc8a9216fd6e1c2c80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Creating volume 23900fbe-f18a-4c90-968a-8379d940e309 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:39:24 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:39:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-23900fbe-f18a-4c90-968a-8379d940e309 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:25 devstack quobyte-client[83066]: System call of process 91233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:25 devstack quobyte-client[83066]: System call of process 91233 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:25 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=29, name=volume-23900fbe-f18a-4c90-968a-8379d940e309, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:39:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-23900fbe-f18a-4c90-968a-8379d940e309 1073741824" returned: 0 in 0.372s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-23900fbe-f18a-4c90-968a-8379d940e309 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-23900fbe-f18a-4c90-968a-8379d940e309" returned: 0 in 0.216s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] <== create_volume: return (677ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:39:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a209ae-b730-48e8-aeb9-dd4c085551c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23900fbe-f18a-4c90-968a-8379d940e309', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ea81dc-5755-4bda-a6c7-87b38b2f0651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:26 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Volume volume-23900fbe-f18a-4c90-968a-8379d940e309 (23900fbe-f18a-4c90-968a-8379d940e309): created successfully Sep 16 01:39:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93ea81dc-5755-4bda-a6c7-87b38b2f0651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Flow 'volume_create_manager' (7ac3dbfc-67ff-4c72-8e20-c82fd96b4708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:26 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-7470e69a-1145-49aa-9ac2-47e4c4aeeb9e tempest-VolumesTestJSON-1142851624 None] Created volume successfully. Sep 16 01:39:27 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Flow 'volume_create_manager' (c6ef2bb5-fb67-4eb4-8030-e3bea951d2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f347fdd-733d-4f90-999b-00e31a712da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f347fdd-733d-4f90-999b-00e31a712da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-8667411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd412fd-c7c3-4529-9435-2837d4e63bf4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a067d5c8d8c4fa8ac11cc18c3363d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:27Z,use_quota=True,user_id='8421edc1de314dc8a9216fd6e1c2c80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d34b786-7ba0-48a1-8cb0-f49ef99f79d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d34b786-7ba0-48a1-8cb0-f49ef99f79d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ac20f5-bc28-474a-baf0-303e27c5e75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ac20f5-bc28-474a-baf0-303e27c5e75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd412fd-c7c3-4529-9435-2837d4e63bf4', 'volume_name': 'volume-acd412fd-c7c3-4529-9435-2837d4e63bf4', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e7b01f-e057-431a-bd20-ca27c2e98baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e7b01f-e057-431a-bd20-ca27c2e98baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eec647e-0a12-4019-a694-f76550644fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:27 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Volume acd412fd-c7c3-4529-9435-2837d4e63bf4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd412fd-c7c3-4529-9435-2837d4e63bf4', 'volume_size': 1} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-8667411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acd412fd-c7c3-4529-9435-2837d4e63bf4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a067d5c8d8c4fa8ac11cc18c3363d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:27Z,use_quota=True,user_id='8421edc1de314dc8a9216fd6e1c2c80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Creating volume acd412fd-c7c3-4529-9435-2837d4e63bf4 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:39:27 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:39:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-acd412fd-c7c3-4529-9435-2837d4e63bf4 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:27 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=30, name=volume-acd412fd-c7c3-4529-9435-2837d4e63bf4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-acd412fd-c7c3-4529-9435-2837d4e63bf4 1073741824" returned: 0 in 0.390s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-acd412fd-c7c3-4529-9435-2837d4e63bf4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-acd412fd-c7c3-4529-9435-2837d4e63bf4" returned: 0 in 0.110s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] <== create_volume: return (575ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.588s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eec647e-0a12-4019-a694-f76550644fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd412fd-c7c3-4529-9435-2837d4e63bf4', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b98ec35-d9a9-43be-90be-6002666fa7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:28 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Volume volume-acd412fd-c7c3-4529-9435-2837d4e63bf4 (acd412fd-c7c3-4529-9435-2837d4e63bf4): created successfully Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b98ec35-d9a9-43be-90be-6002666fa7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Flow 'volume_create_manager' (c6ef2bb5-fb67-4eb4-8030-e3bea951d2ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-95f300ab-ffdd-4a9a-9b2d-98789c2dd182 tempest-VolumesTestJSON-1142851624 None] Created volume successfully. Sep 16 01:39:30 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Flow 'volume_create_manager' (0aa36659-d1ae-491d-bb79-cbed882564f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed970bd4-eeee-4345-9557-00a3cfb074cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed970bd4-eeee-4345-9557-00a3cfb074cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1408116053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f114128c-736c-4a7b-be5d-6a5dd48f2bea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a067d5c8d8c4fa8ac11cc18c3363d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:30Z,use_quota=True,user_id='8421edc1de314dc8a9216fd6e1c2c80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8378546-2bc5-4f25-ac03-3bf1f9195025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8378546-2bc5-4f25-ac03-3bf1f9195025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89679a2c-3dab-49af-8037-ecee3d19b156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89679a2c-3dab-49af-8037-ecee3d19b156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f114128c-736c-4a7b-be5d-6a5dd48f2bea', 'volume_name': 'volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e26082-2ecb-4b61-bfcc-60097eed54f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e26082-2ecb-4b61-bfcc-60097eed54f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d19d02-7f2d-4a5d-a925-705aee29f51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:31 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Volume f114128c-736c-4a7b-be5d-6a5dd48f2bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea', 'volume_size': 1} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1408116053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f114128c-736c-4a7b-be5d-6a5dd48f2bea,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='7a067d5c8d8c4fa8ac11cc18c3363d4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:30Z,use_quota=True,user_id='8421edc1de314dc8a9216fd6e1c2c80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Creating volume f114128c-736c-4a7b-be5d-6a5dd48f2bea {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:39:31 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:31 devstack quobyte-client[83066]: System call of process 91267 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:31 devstack quobyte-client[83066]: System call of process 91267 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:31 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=31, name=volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea 1073741824" returned: 0 in 0.614s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea" returned: 0 in 0.499s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] <== create_volume: return (1378ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:39:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.440s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6d19d02-7f2d-4a5d-a925-705aee29f51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a35a482-a07c-4a19-a5c5-ee05ef800941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:33 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Volume volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea (f114128c-736c-4a7b-be5d-6a5dd48f2bea): created successfully Sep 16 01:39:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a35a482-a07c-4a19-a5c5-ee05ef800941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Flow 'volume_create_manager' (0aa36659-d1ae-491d-bb79-cbed882564f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:33 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8a2d6964-0390-4406-9c37-29075132d44b tempest-VolumesTestJSON-1142851624 None] Created volume successfully. Sep 16 01:39:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Acquiring lock "cinder-f114128c-736c-4a7b-be5d-6a5dd48f2bea-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Lock "cinder-f114128c-736c-4a7b-be5d-6a5dd48f2bea-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:36 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=65,cinder:SELECT=42,cinder:INSERT=13,cinder:DELETE=7 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:39:36 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=51,cinder:UPDATE=68,cinder:DELETE=8,cinder:INSERT=11 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:39:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Acquiring lock "cinder-quobyte-f114128c-736c-4a7b-be5d-6a5dd48f2bea" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Lock "cinder-quobyte-f114128c-736c-4a7b-be5d-6a5dd48f2bea" acquired by "delete_volume" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6492eca0-132c-485f-bf8f-11d697d69642]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:39:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea" returned: 0 in 0.623s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f114128c-736c-4a7b-be5d-6a5dd48f2bea" returned: 0 in 0.140s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Lock "cinder-quobyte-f114128c-736c-4a7b-be5d-6a5dd48f2bea" released by "delete_volume" :: held 0.949s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Created reservations ['d845e8c9-cd15-4d53-b7b3-f6c13a06c21b', 'e23857cb-83d6-43cc-83d5-f36b90f8b0ad', '9df57baa-c2b0-480b-b1df-c29fdc3c2f1e', 'c36a9b42-934e-4f62-bb09-9bb252b9f6cd'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.116s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:39:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Deleted volume successfully. Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4a4da243-2494-4451-9f0c-31e22afc87d5 tempest-VolumesTestJSON-1142851624 None] Lock "cinder-f114128c-736c-4a7b-be5d-6a5dd48f2bea-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Acquiring lock "cinder-acd412fd-c7c3-4529-9435-2837d4e63bf4-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Lock "cinder-acd412fd-c7c3-4529-9435-2837d4e63bf4-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:39 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Acquiring lock "cinder-quobyte-acd412fd-c7c3-4529-9435-2837d4e63bf4" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Lock "cinder-quobyte-acd412fd-c7c3-4529-9435-2837d4e63bf4" acquired by "delete_volume" :: waited 0.026s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:39 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f905676-04df-4106-8964-7cdf49348992]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:39:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-acd412fd-c7c3-4529-9435-2837d4e63bf4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-acd412fd-c7c3-4529-9435-2837d4e63bf4" returned: 0 in 0.863s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-acd412fd-c7c3-4529-9435-2837d4e63bf4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-acd412fd-c7c3-4529-9435-2837d4e63bf4" returned: 0 in 0.371s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Lock "cinder-quobyte-acd412fd-c7c3-4529-9435-2837d4e63bf4" released by "delete_volume" :: held 1.670s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:41 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Created reservations ['3a26b83f-f081-4486-b561-d40bc4bc20ba', '7974f4ed-5641-4689-ad34-df1a21aec0b9', '31db4fe7-ed1f-492d-858b-6c74dbd9ce45', '0a90ac80-4c97-4a83-a4ff-6fff9b45a4d0'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:39:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.146s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:42 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:39:42 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Deleted volume successfully. Sep 16 01:39:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-79962fa1-1d0f-4cc0-b59b-31176fa1e082 tempest-VolumesTestJSON-1142851624 None] Lock "cinder-acd412fd-c7c3-4529-9435-2837d4e63bf4-delete_volume" released by "delete_volume" :: held 3.448s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Acquiring lock "cinder-23900fbe-f18a-4c90-968a-8379d940e309-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Lock "cinder-23900fbe-f18a-4c90-968a-8379d940e309-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:43 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Acquiring lock "cinder-quobyte-23900fbe-f18a-4c90-968a-8379d940e309" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:39:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Lock "cinder-quobyte-23900fbe-f18a-4c90-968a-8379d940e309" acquired by "delete_volume" :: waited 0.030s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:39:43 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf985ca-ce0a-4181-b13f-04c9fcfa8298]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:39:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-23900fbe-f18a-4c90-968a-8379d940e309 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:44 devstack quobyte-client[83066]: System call of process 91330 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-23900fbe-f18a-4c90-968a-8379d940e309" returned: 0 in 1.447s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-23900fbe-f18a-4c90-968a-8379d940e309 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-23900fbe-f18a-4c90-968a-8379d940e309" returned: 0 in 0.172s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Lock "cinder-quobyte-23900fbe-f18a-4c90-968a-8379d940e309" released by "delete_volume" :: held 2.197s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Created reservations ['0f340290-80cf-47f9-b684-11aa3bd63318', '53b1e9a7-5399-4a79-a5d6-bad35dcc5499', 'c89bac46-654f-4d8f-a43c-a39552216c88', '9473989d-2440-4d3b-b4d1-db3415d8e28e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.268s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:46 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:39:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Deleted volume successfully. Sep 16 01:39:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3dfe5a24-cfd3-4f46-92c5-0691de47bdcc tempest-VolumesTestJSON-1142851624 None] Lock "cinder-23900fbe-f18a-4c90-968a-8379d940e309-delete_volume" released by "delete_volume" :: held 4.354s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:39:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4d2320aa-44af-4ee3-baf3-d0671d035c70 tempest-BackendsCapabilitiesAdminTestsJSON-1320082451 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83041) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b5c89759-6f90-4a24-a5ac-1ac21647aff1 tempest-BackendsCapabilitiesAdminTestsJSON-1320082451 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.9154777526855, 'free_capacity_gb': 924.9154777526855, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83041) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}} Sep 16 01:39:53 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Flow 'volume_create_manager' (2b7d7661-be52-4666-90dc-926775837ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a2c9a7-358b-4794-9253-5b97c4bd3949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24a2c9a7-358b-4794-9253-5b97c4bd3949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-396570770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7655aa-5d3c-4fb8-bcc8-176cf9201c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e9a865c9a84c88a460265363eaa0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:53Z,use_quota=True,user_id='ba06bb36306349128fdf5f694b8fc343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099a20ee-c00b-492f-8ebb-b990a0b3af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099a20ee-c00b-492f-8ebb-b990a0b3af33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f4b799-f9c9-425b-9b8a-6e0da491ecf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5f4b799-f9c9-425b-9b8a-6e0da491ecf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c7655aa-5d3c-4fb8-bcc8-176cf9201c49', 'volume_name': 'volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca66482-d774-49e7-87c5-a6e48ce73aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca66482-d774-49e7-87c5-a6e48ce73aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede0397d-66fb-4c09-8b57-48d033e6efec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:53 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Volume 0c7655aa-5d3c-4fb8-bcc8-176cf9201c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49', 'volume_size': 1} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-396570770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c7655aa-5d3c-4fb8-bcc8-176cf9201c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e9a865c9a84c88a460265363eaa0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:53Z,use_quota=True,user_id='ba06bb36306349128fdf5f694b8fc343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Creating volume 0c7655aa-5d3c-4fb8-bcc8-176cf9201c49 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:39:53 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:39:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:54 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=32, name=volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49 1073741824" returned: 0 in 0.487s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49" returned: 0 in 0.151s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] <== create_volume: return (712ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede0397d-66fb-4c09-8b57-48d033e6efec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92417fb0-fbd2-4936-b604-d2bd0b3111aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:54 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Volume volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49 (0c7655aa-5d3c-4fb8-bcc8-176cf9201c49): created successfully Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92417fb0-fbd2-4936-b604-d2bd0b3111aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Flow 'volume_create_manager' (2b7d7661-be52-4666-90dc-926775837ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:54 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-68dab36b-3d6e-435f-bd63-c06665395b98 tempest-VolumesListAdminTestJSON-1501374909 None] Created volume successfully. Sep 16 01:39:56 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Flow 'volume_create_manager' (c517c416-cda8-4499-9b9a-054b9a888dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09f32dc-f749-472c-826e-e25713f56cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a09f32dc-f749-472c-826e-e25713f56cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744454031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d4f7a8-b536-4828-9346-d2e3efb8f49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e9a865c9a84c88a460265363eaa0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:57Z,use_quota=True,user_id='ba06bb36306349128fdf5f694b8fc343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac5ae9e-b7d2-41f6-9227-54f37679220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac5ae9e-b7d2-41f6-9227-54f37679220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d030b2-77e5-4fa2-b47d-29c257bc6b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d030b2-77e5-4fa2-b47d-29c257bc6b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5d4f7a8-b536-4828-9346-d2e3efb8f49f', 'volume_name': 'volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44c8353-cf93-4b99-95cd-2d1a656263c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44c8353-cf93-4b99-95cd-2d1a656263c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325cfc51-637e-468b-913e-2e737233c519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:56 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Volume a5d4f7a8-b536-4828-9346-d2e3efb8f49f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f', 'volume_size': 1} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1744454031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5d4f7a8-b536-4828-9346-d2e3efb8f49f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e9a865c9a84c88a460265363eaa0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:57Z,use_quota=True,user_id='ba06bb36306349128fdf5f694b8fc343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Creating volume a5d4f7a8-b536-4828-9346-d2e3efb8f49f {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:39:56 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:39:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:57 devstack quobyte-client[83066]: System call of process 91345 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:57 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=33, name=volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:39:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f 1073741824" returned: 0 in 0.515s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f" returned: 0 in 0.111s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:39:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] <== create_volume: return (734ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:39:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:57 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (325cfc51-637e-468b-913e-2e737233c519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:57 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e974390-6872-4d68-81ed-d8e67b57c2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:58 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Volume volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f (a5d4f7a8-b536-4828-9346-d2e3efb8f49f): created successfully Sep 16 01:39:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e974390-6872-4d68-81ed-d8e67b57c2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Flow 'volume_create_manager' (c517c416-cda8-4499-9b9a-054b9a888dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:58 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f7eacecb-4666-4ed9-bc97-bcc50e38033f tempest-VolumesListAdminTestJSON-1501374909 None] Created volume successfully. Sep 16 01:39:59 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Flow 'volume_create_manager' (8d278251-8a57-4fec-aa2a-6b2888e43497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12070c1-9ff8-4c05-ae26-c06a1fc91f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12070c1-9ff8-4c05-ae26-c06a1fc91f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1257861783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f163dcc-4b78-4fcb-b134-513de0567733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e9a865c9a84c88a460265363eaa0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:59Z,use_quota=True,user_id='ba06bb36306349128fdf5f694b8fc343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44de036a-0f8b-432c-b709-7cbf5e4ed89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44de036a-0f8b-432c-b709-7cbf5e4ed89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ac8e61-7603-48ab-8e5d-67b528929113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4ac8e61-7603-48ab-8e5d-67b528929113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f163dcc-4b78-4fcb-b134-513de0567733', 'volume_name': 'volume-7f163dcc-4b78-4fcb-b134-513de0567733', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fd669b-e3ab-4a6c-8060-692d1281a6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95fd669b-e3ab-4a6c-8060-692d1281a6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc4a2d6-776d-459d-b673-99152cf96e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:39:59 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Volume 7f163dcc-4b78-4fcb-b134-513de0567733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f163dcc-4b78-4fcb-b134-513de0567733', 'volume_size': 1} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1257861783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f163dcc-4b78-4fcb-b134-513de0567733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02e9a865c9a84c88a460265363eaa0d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:39:59Z,use_quota=True,user_id='ba06bb36306349128fdf5f694b8fc343',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Creating volume 7f163dcc-4b78-4fcb-b134-513de0567733 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:39:59 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:39:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7f163dcc-4b78-4fcb-b134-513de0567733 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:39:59 devstack quobyte-client[83066]: System call of process 91349 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:39:59 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=34, name=volume-7f163dcc-4b78-4fcb-b134-513de0567733, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7f163dcc-4b78-4fcb-b134-513de0567733 1073741824" returned: 0 in 0.397s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7f163dcc-4b78-4fcb-b134-513de0567733 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7f163dcc-4b78-4fcb-b134-513de0567733" returned: 0 in 0.104s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] <== create_volume: return (607ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.622s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdc4a2d6-776d-459d-b673-99152cf96e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f163dcc-4b78-4fcb-b134-513de0567733', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0597492-4e92-4164-87b5-db8b3c79ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:00 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Volume volume-7f163dcc-4b78-4fcb-b134-513de0567733 (7f163dcc-4b78-4fcb-b134-513de0567733): created successfully Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0597492-4e92-4164-87b5-db8b3c79ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Flow 'volume_create_manager' (8d278251-8a57-4fec-aa2a-6b2888e43497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8b63b144-c35d-49fb-9ab0-d26d487b1e8a tempest-VolumesListAdminTestJSON-1501374909 None] Created volume successfully. Sep 16 01:40:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-bb5a1706-aa89-43dc-82cf-417fe08d1c3f tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bb5a1706-aa89-43dc-82cf-417fe08d1c3f tempest-GroupSnapshotsTest-957895633 None] Group tempest-GroupSnapshotsTest-Group-96630591: creating Sep 16 01:40:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bb5a1706-aa89-43dc-82cf-417fe08d1c3f tempest-GroupSnapshotsTest-957895633 None] Group tempest-GroupSnapshotsTest-Group-96630591: created successfully Sep 16 01:40:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bb5a1706-aa89-43dc-82cf-417fe08d1c3f tempest-GroupSnapshotsTest-957895633 None] Create group completed successfully. Sep 16 01:40:02 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Flow 'volume_create_manager' (8eef91a8-9d5a-4c47-a67d-f0319f902a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccbf1a2-de3b-4810-a152-c48576e2af60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccbf1a2-de3b-4810-a152-c48576e2af60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513366f5-ba61-489c-a734-1b2c2f326116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f780b0ae314ed0a38d3425a5308ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:02Z,use_quota=True,user_id='ddcd2a962fa44c05b566a03285251176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf427d80-5640-4ba8-a08f-831ca075cfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf427d80-5640-4ba8-a08f-831ca075cfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27579631-b3cb-4fdb-a78d-7cce4d08fc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27579631-b3cb-4fdb-a78d-7cce4d08fc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513366f5-ba61-489c-a734-1b2c2f326116', 'volume_name': 'volume-513366f5-ba61-489c-a734-1b2c2f326116', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096b7278-367a-48c4-a370-9a9b6da62c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096b7278-367a-48c4-a370-9a9b6da62c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7833db6b-121b-4f41-b8fc-25935e38c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:02 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Volume 513366f5-ba61-489c-a734-1b2c2f326116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513366f5-ba61-489c-a734-1b2c2f326116', 'volume_size': 1} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:02Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513366f5-ba61-489c-a734-1b2c2f326116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f780b0ae314ed0a38d3425a5308ff8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:02Z,use_quota=True,user_id='ddcd2a962fa44c05b566a03285251176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Creating volume 513366f5-ba61-489c-a734-1b2c2f326116 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:40:02 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:40:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-513366f5-ba61-489c-a734-1b2c2f326116 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:02 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=35, name=volume-513366f5-ba61-489c-a734-1b2c2f326116, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-513366f5-ba61-489c-a734-1b2c2f326116 1073741824" returned: 0 in 0.662s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-513366f5-ba61-489c-a734-1b2c2f326116 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:03 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Flow 'volume_create_manager' (b19291a0-3168-47c4-acc3-2dcbaf219c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beccc8eb-ab58-45f7-9a72-02dedc6cbb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-513366f5-ba61-489c-a734-1b2c2f326116" returned: 0 in 0.480s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] <== create_volume: return (1211ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (beccc8eb-ab58-45f7-9a72-02dedc6cbb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-621574307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9d1966-0567-45d7-9c15-54319e960656,host='devstack@QuobyteHD#QuobyteHD',id=6e2d72d3-8277-4a8f-937e-1df73dc4e46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8297e2320aed46198901015aed00fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:03Z,use_quota=True,user_id='dde32884233043d6acea2cb725d58877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(271c5e12-74fa-4de5-8c89-81748e91dd72),volume_type_id=271c5e12-74fa-4de5-8c89-81748e91dd72)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b02b8f-ff46-4d0d-a45b-e39d1138be69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73b02b8f-ff46-4d0d-a45b-e39d1138be69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e16838-1673-46f4-a4a8-47051b1b2c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85e16838-1673-46f4-a4a8-47051b1b2c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2d72d3-8277-4a8f-937e-1df73dc4e46f', 'volume_name': 'volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd46486-e2e4-4165-9c94-6318e73821db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cd46486-e2e4-4165-9c94-6318e73821db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4917f9-5c1b-4a24-b5b9-b24e45a36eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:03 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Volume 6e2d72d3-8277-4a8f-937e-1df73dc4e46f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f', 'volume_size': 1} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fa9d1966-0567-45d7-9c15-54319e960656,created_at=2025-09-15T23:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-621574307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fa9d1966-0567-45d7-9c15-54319e960656,host='devstack@QuobyteHD#QuobyteHD',id=6e2d72d3-8277-4a8f-937e-1df73dc4e46f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8297e2320aed46198901015aed00fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:03Z,use_quota=True,user_id='dde32884233043d6acea2cb725d58877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(271c5e12-74fa-4de5-8c89-81748e91dd72),volume_type_id=271c5e12-74fa-4de5-8c89-81748e91dd72)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Creating volume 6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:40:03 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:40:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:04 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=36, name=volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7833db6b-121b-4f41-b8fc-25935e38c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513366f5-ba61-489c-a734-1b2c2f326116', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a2aa74-3587-4088-9db2-2f62b1b48276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:04 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Volume volume-513366f5-ba61-489c-a734-1b2c2f326116 (513366f5-ba61-489c-a734-1b2c2f326116): created successfully Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65a2aa74-3587-4088-9db2-2f62b1b48276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Flow 'volume_create_manager' (8eef91a8-9d5a-4c47-a67d-f0319f902a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f 1073741824" returned: 0 in 0.839s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.407s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:40:04 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-20095e1d-ce9f-46cb-b478-ba1245d55785 tempest-VolumesListAdminTestJSON-1324505554 None] Created volume successfully. Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" returned: 0 in 0.320s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] <== create_volume: return (1200ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.209s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4917f9-5c1b-4a24-b5b9-b24e45a36eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df910f9d-3e5b-48c5-ae03-de9a95987ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:05 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Volume volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f (6e2d72d3-8277-4a8f-937e-1df73dc4e46f): created successfully Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df910f9d-3e5b-48c5-ae03-de9a95987ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Flow 'volume_create_manager' (b19291a0-3168-47c4-acc3-2dcbaf219c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:05 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-504a86e6-f227-470a-abe9-8592710ed8c0 tempest-GroupSnapshotsTest-957895633 None] Created volume successfully. Sep 16 01:40:05 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] GroupSnapshot c107f1d4-bbb8-49f7-bf72-20e78a7a7782: creating. Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Acquiring lock "cinder-513366f5-ba61-489c-a734-1b2c2f326116-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "cinder-513366f5-ba61-489c-a734-1b2c2f326116-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:05 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Group snapshot c107f1d4-bbb8-49f7-bf72-20e78a7a7782: creating. {{(pid=83041) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "cinder-7f163dcc-4b78-4fcb-b134-513de0567733-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Creating offline snapshot 01d20e59-72ca-4de0-90b2-a984366e0608 of volume 6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-7f163dcc-4b78-4fcb-b134-513de0567733-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7517ba-1644-4b2e-b29f-cc2e150e14d1]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Acquiring lock "cinder-quobyte-513366f5-ba61-489c-a734-1b2c2f326116" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "cinder-quobyte-513366f5-ba61-489c-a734-1b2c2f326116" acquired by "delete_volume" :: waited 0.119s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "cinder-quobyte-7f163dcc-4b78-4fcb-b134-513de0567733" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-quobyte-7f163dcc-4b78-4fcb-b134-513de0567733" acquired by "delete_volume" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[efdb88b9-7473-4336-9b5d-ec65ea58b5b3]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-513366f5-ba61-489c-a734-1b2c2f326116 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:06 devstack quobyte-client[83066]: System call of process 91364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1295f816-d2cd-4373-8668-66c1265197c0]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7f163dcc-4b78-4fcb-b134-513de0567733 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" returned: 0 in 0.954s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:07 devstack quobyte-client[83066]: System call of process 91370 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:07 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=37, name=volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7f163dcc-4b78-4fcb-b134-513de0567733" returned: 0 in 0.666s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7f163dcc-4b78-4fcb-b134-513de0567733 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 1G" returned: 0 in 0.562s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-513366f5-ba61-489c-a734-1b2c2f326116" returned: 0 in 1.085s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-513366f5-ba61-489c-a734-1b2c2f326116 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7f163dcc-4b78-4fcb-b134-513de0567733" returned: 0 in 0.361s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img rebase -u -b volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608" returned: 0 in 0.317s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-quobyte-7f163dcc-4b78-4fcb-b134-513de0567733" released by "delete_volume" :: held 1.467s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-513366f5-ba61-489c-a734-1b2c2f326116" returned: 0 in 0.458s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "cinder-quobyte-513366f5-ba61-489c-a734-1b2c2f326116" released by "delete_volume" :: held 1.730s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608" returned: 0 in 0.329s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608" returned: 0 in 0.371s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Created reservations ['14c79634-ee5e-4012-8a1d-6a636b8b2c51', '292462ae-b56a-429f-ae8c-54e972f3a2ec', 'cce080fd-9692-4e9f-ae87-174cdbe4886e', '2b6a390d-7e14-49b9-974f-c7961e18e1f2'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Created reservations ['789408e9-711f-4bb2-8bf1-91aa76bc8889', '2762fadd-56a9-4be7-baaf-b90b3ff53391', '024efb47-827e-49b7-be08-43dc5fff31e8', 'fbbab1e2-2c4f-4bf1-a9d1-d443d74674bc'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.info" returned: 0 in 0.354s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.info" returned: 0 in 0.225s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.415s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.300s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:10 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Deleted volume successfully. Sep 16 01:40:10 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-304d9bf7-e5d1-47e7-9204-5c8b34134f51 tempest-GroupSnapshotsTest-957895633 None] group_snapshot c107f1d4-bbb8-49f7-bf72-20e78a7a7782: created successfully Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.414s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4cdf8b99-58ae-4381-8cda-b8e56fa25d76 tempest-VolumesListAdminTestJSON-1324505554 None] Lock "cinder-513366f5-ba61-489c-a734-1b2c2f326116-delete_volume" released by "delete_volume" :: held 4.699s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:10 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Deleted volume successfully. Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-41a6b8e2-0f65-48fa-88b6-5915dfc28dfa tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-7f163dcc-4b78-4fcb-b134-513de0567733-delete_volume" released by "delete_volume" :: held 4.646s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "cinder-a5d4f7a8-b536-4828-9346-d2e3efb8f49f-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-a5d4f7a8-b536-4828-9346-d2e3efb8f49f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "cinder-quobyte-a5d4f7a8-b536-4828-9346-d2e3efb8f49f" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-quobyte-a5d4f7a8-b536-4828-9346-d2e3efb8f49f" acquired by "delete_volume" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11e3b7b-a3ce-4fb8-9144-db418e331b0e]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f" returned: 0 in 0.780s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a5d4f7a8-b536-4828-9346-d2e3efb8f49f" returned: 0 in 0.432s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-quobyte-a5d4f7a8-b536-4828-9346-d2e3efb8f49f" released by "delete_volume" :: held 1.336s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-01d20e59-72ca-4de0-90b2-a984366e0608-a7750b38-b87c-447c-949d-8577fb5e4d1c" by "_create_volume_from_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-01d20e59-72ca-4de0-90b2-a984366e0608-a7750b38-b87c-447c-949d-8577fb5e4d1c" acquired by "_create_volume_from_snapshot" :: waited 0.060s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Creating volume a7750b38-b87c-447c-949d-8577fb5e4d1c from snapshot 01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-a7750b38-b87c-447c-949d-8577fb5e4d1c" by "_copy_volume_from_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-a7750b38-b87c-447c-949d-8577fb5e4d1c" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] snapshot: 01d20e59-72ca-4de0-90b2-a984366e0608, volume: a7750b38-b87c-447c-949d-8577fb5e4d1c, {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Created reservations ['a6cab19d-5d96-4c08-9c0d-96993d250017', '730fe681-64fc-4dff-b83d-49ce0553f110', '0f1e562e-5d26-4a8a-8b96-952a289592d7', '9f28784c-8f8c-4ef3-9f78-171da5fe26b3'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa123f02-9eab-4c83-9ee2-c5eeb6c41846]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:13 devstack quobyte-client[83066]: System call of process 91435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.038s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608" returned: 0 in 0.750s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Creating direct copy from snapshot {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13b6c40-2f4d-4611-9b78-bfb4f58420cd]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.268s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:13 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:40:13 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Deleted volume successfully. Sep 16 01:40:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-63794b70-0534-48ca-b971-c9912abb8c77 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-a5d4f7a8-b536-4828-9346-d2e3efb8f49f-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" returned: 0 in 0.676s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:14 devstack cinder-volume[83041]: DEBUG cinder.utils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c not found in is_blk_device check {{(pid=83041) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 01:40:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:14 devstack quobyte-client[83066]: System call of process 91443 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:14 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=39, name=volume-a7750b38-b87c-447c-949d-8577fb5e4d1c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "cinder-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "cinder-quobyte-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-quobyte-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49" acquired by "delete_volume" :: waited 0.088s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:16 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1a9ca5-335e-4712-9a48-943bc8b768f5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49" returned: 0 in 2.256s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49" returned: 0 in 0.982s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-quobyte-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49" released by "delete_volume" :: held 4.837s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:21 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Created reservations ['2bef82f2-32ae-4edc-83ab-732779e1fa70', '8aaa40b2-809c-4402-93bf-6ebc79d8f502', 'd70dd71d-4a6d-465e-a212-6cc9d2bf6991', 'a98b087e-5826-4dfe-b5f2-8b5fe180c4e2'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c" returned: 0 in 7.912s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[51987cbd-446e-41ad-8443-84114f8131fe]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.165s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:40:22 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Deleted volume successfully. Sep 16 01:40:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de9e7218-d819-4d96-b2e5-b32806712aa8 tempest-VolumesListAdminTestJSON-1501374909 None] Lock "cinder-0c7655aa-5d3c-4fb8-bcc8-176cf9201c49-delete_volume" released by "delete_volume" :: held 7.983s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" returned: 0 in 0.718s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:23 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f, size 1024.00 MB, duration 7.92 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:40:23 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Converted 1024.00 MB image at 129.36 MB/s Sep 16 01:40:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c" returned: 0 in 0.110s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-a7750b38-b87c-447c-949d-8577fb5e4d1c" released by "_copy_volume_from_snapshot" :: held 10.563s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-01d20e59-72ca-4de0-90b2-a984366e0608-a7750b38-b87c-447c-949d-8577fb5e4d1c" released by "_create_volume_from_snapshot" :: held 10.602s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.673s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:23 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d91781fc-458e-46bc-8e9c-168c44ee7bf7 tempest-GroupSnapshotsTest-957895633 None] Create group from source-snapshot-c107f1d4-bbb8-49f7-bf72-20e78a7a7782 completed successfully. Sep 16 01:40:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-a7750b38-b87c-447c-949d-8577fb5e4d1c" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-a7750b38-b87c-447c-949d-8577fb5e4d1c" acquired by "delete_volume" :: waited 0.017s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:24 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e029471-e56d-45a5-a308-8c11123741b5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c" returned: 0 in 0.424s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a7750b38-b87c-447c-949d-8577fb5e4d1c" returned: 0 in 0.112s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-a7750b38-b87c-447c-949d-8577fb5e4d1c" released by "delete_volume" :: held 0.688s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:25 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Created reservations ['7bd2fd32-b846-49ff-a75f-2a0970e5a354'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:25 devstack cinder-volume[83041]: WARNING cinder.quota [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-207504857 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-207504857, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:40:25 devstack cinder-volume[83041]: WARNING cinder.quota [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-207504857 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-207504857, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:40:25 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Created reservations ['ee7e3771-54a7-4ab7-869b-dd22076dc482', '876a13de-22f3-4636-94d9-5dde87073425', '9e9d82fc-5ea8-4d3a-a99b-e9678a5fbc01', 'b3f9dad4-409f-453e-bb3a-ae916c8f38c6'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.097s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:26 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:40:26 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6eefca0a-65d6-47de-91d0-992656c024ca tempest-GroupSnapshotsTest-957895633 None] Delete group completed successfully. Sep 16 01:40:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] group_snapshot c107f1d4-bbb8-49f7-bf72-20e78a7a7782: deleting Sep 16 01:40:27 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] group_snapshot c107f1d4-bbb8-49f7-bf72-20e78a7a7782: deleting {{(pid=83041) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-01d20e59-72ca-4de0-90b2-a984366e0608" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-01d20e59-72ca-4de0-90b2-a984366e0608" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Deleting offline snapshot 01d20e59-72ca-4de0-90b2-a984366e0608 of volume 6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] snapshot_file for this snap is: volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1735cfa9-8409-4e79-8b74-3a6865f08b07]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608" returned: 0 in 0.449s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:40:28 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efe709c-6743-42ae-9b80-52c7302dc8fe]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:28 devstack quobyte-client[83066]: System call of process 91526 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" returned: 0 in 0.755s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:29 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:40:29 devstack quobyte-client[83066]: System call of process 91530 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Flow 'volume_create_manager' (ebc8ff83-7d81-490e-87a3-62bd8c6ecb67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286d1e24-5854-4050-9188-9371366a587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286d1e24-5854-4050-9188-9371366a587b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-402361440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90511548-a2d3-4084-8d2f-6fc022cdf6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955f222e1e1f4c55865a9526c2b4bbb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:29Z,use_quota=True,user_id='9ef7683b1297427497d2d1a33003512d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e67bbcb-c7e6-49c6-901a-bb7524d9e819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e67bbcb-c7e6-49c6-901a-bb7524d9e819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08701b6e-4a85-4fef-a843-07aebb1e7bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08701b6e-4a85-4fef-a843-07aebb1e7bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90511548-a2d3-4084-8d2f-6fc022cdf6b4', 'volume_name': 'volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d039a578-8403-41c4-bea4-d7550ace37b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d039a578-8403-41c4-bea4-d7550ace37b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841f1af3-a631-4578-ab90-d2be596f2897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:29 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Volume 90511548-a2d3-4084-8d2f-6fc022cdf6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4', 'volume_size': 1} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-402361440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90511548-a2d3-4084-8d2f-6fc022cdf6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='955f222e1e1f4c55865a9526c2b4bbb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:29Z,use_quota=True,user_id='9ef7683b1297427497d2d1a33003512d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Creating volume 90511548-a2d3-4084-8d2f-6fc022cdf6b4 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:40:29 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:29 devstack quobyte-client[83066]: System call of process 91533 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:29 devstack quobyte-client[83066]: System call of process 91533 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608" returned: 0 in 0.678s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:29 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=40, name=volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4 1073741824" returned: 0 in 0.616s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f.01d20e59-72ca-4de0-90b2-a984366e0608" returned: 0 in 0.426s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4" returned: 0 in 0.311s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] <== create_volume: return (1008ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-01d20e59-72ca-4de0-90b2-a984366e0608" released by "_delete_snapshot" :: held 3.153s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (841f1af3-a631-4578-ab90-d2be596f2897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8951d617-0025-4e94-a4ae-14869e787b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" released by "delete_snapshot" :: held 3.286s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:31 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Volume volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4 (90511548-a2d3-4084-8d2f-6fc022cdf6b4): created successfully Sep 16 01:40:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8951d617-0025-4e94-a4ae-14869e787b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Flow 'volume_create_manager' (ebc8ff83-7d81-490e-87a3-62bd8c6ecb67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-afad7c2f-0b06-4585-b561-57162b34f1da tempest-AbsoluteLimitsTests-903081713 None] Created volume successfully. Sep 16 01:40:31 devstack cinder-volume[83041]: WARNING cinder.quota [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-207504857 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-207504857, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:40:31 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] Created reservations ['72307bc8-1ad9-4707-9adb-1b99f2859f53', 'a7f861a3-32a9-4003-a9d1-388af7062a32', '7539cce9-b827-4d04-9b5a-ce25b8f6c0ec', 'e471fb57-167c-4bd9-b1f9-a882f1b7027c'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4694a362-a0d1-45de-909e-587b9fa919ce tempest-GroupSnapshotsTest-957895633 None] group_snapshot c107f1d4-bbb8-49f7-bf72-20e78a7a7782: deleted successfully Sep 16 01:40:32 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" acquired by "delete_volume" :: waited 0.035s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:32 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[5404bc7b-2cec-4333-9ea2-03d375c14714]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Acquiring lock "cinder-90511548-a2d3-4084-8d2f-6fc022cdf6b4-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Lock "cinder-90511548-a2d3-4084-8d2f-6fc022cdf6b4-delete_volume" acquired by "delete_volume" :: waited 0.196s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" returned: 0 in 0.853s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" returned: 0 in 0.595s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-6e2d72d3-8277-4a8f-937e-1df73dc4e46f" released by "delete_volume" :: held 1.685s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:34 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Acquiring lock "cinder-quobyte-90511548-a2d3-4084-8d2f-6fc022cdf6b4" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Lock "cinder-quobyte-90511548-a2d3-4084-8d2f-6fc022cdf6b4" acquired by "delete_volume" :: waited 0.067s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:34 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e043eb90-66be-433b-a8f2-6ac96a0852b0]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4" returned: 0 in 0.776s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90511548-a2d3-4084-8d2f-6fc022cdf6b4" returned: 0 in 0.279s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Lock "cinder-quobyte-90511548-a2d3-4084-8d2f-6fc022cdf6b4" released by "delete_volume" :: held 1.259s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Created reservations ['2903047f-ccb9-4f08-acf8-87505241ce9f'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:35 devstack cinder-volume[83041]: WARNING cinder.db.sqlalchemy.api [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-207504857'] Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Created reservations ['ece65479-7f69-4e87-9e01-9d6d1a930294', 'c1735b23-4929-4acb-9bb0-8341ca7ffd0b', '03be1afd-23ca-496e-8c94-8ae5be3aa87b', '89139055-06be-4d7f-a283-176b6854bd9b'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Created reservations ['a40df4af-b724-4b6b-a723-4bcaa0bec567', '82bc9bfb-08a4-4b6a-bcaf-99560fe0cf28', '2388da8f-a231-4055-89e6-941eed286c9b', '3f3aee7e-62d3-48ad-9239-7770c36b8704'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.396s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:40:36 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Deleted volume successfully. Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4e8978f-4932-46d2-adf1-13e5bde24dee tempest-AbsoluteLimitsTests-903081713 None] Lock "cinder-90511548-a2d3-4084-8d2f-6fc022cdf6b4-delete_volume" released by "delete_volume" :: held 3.650s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=87,cinder:INSERT=23,cinder:UPDATE=113,cinder:DELETE=6 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.218s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:37 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:40:37 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dd0b9c72-98b6-4aeb-8580-7fd71f5642fc tempest-GroupSnapshotsTest-957895633 None] Delete group completed successfully. Sep 16 01:40:38 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=79,cinder:UPDATE=101,cinder:DELETE=8,cinder:INSERT=23 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:40:38 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5741d474-fc03-47fe-a3c8-d3421045e48a tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5741d474-fc03-47fe-a3c8-d3421045e48a tempest-GroupSnapshotsTest-957895633 None] Group tempest-GroupSnapshotsTest-Group-688974907: creating Sep 16 01:40:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5741d474-fc03-47fe-a3c8-d3421045e48a tempest-GroupSnapshotsTest-957895633 None] Group tempest-GroupSnapshotsTest-Group-688974907: created successfully Sep 16 01:40:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5741d474-fc03-47fe-a3c8-d3421045e48a tempest-GroupSnapshotsTest-957895633 None] Create group completed successfully. Sep 16 01:40:39 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Flow 'volume_create_manager' (88410600-2848-437a-84da-2883a4eb99a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c066915-b112-4e6a-8def-489d9820bcba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c066915-b112-4e6a-8def-489d9820bcba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-669064186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba58c1bd-0a09-4278-a795-7c62765296a8,host='devstack@QuobyteHD#QuobyteHD',id=7a45f846-fece-4032-aaec-f5ce0d161af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8297e2320aed46198901015aed00fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:39Z,use_quota=True,user_id='dde32884233043d6acea2cb725d58877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ac428f6-8fd5-4c99-bb19-f3d096a1453e),volume_type_id=8ac428f6-8fd5-4c99-bb19-f3d096a1453e)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6099c547-21c6-44b7-a06c-5b507d81c7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6099c547-21c6-44b7-a06c-5b507d81c7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444f0778-ce85-4a92-af5b-76586387fc41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444f0778-ce85-4a92-af5b-76586387fc41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a45f846-fece-4032-aaec-f5ce0d161af7', 'volume_name': 'volume-7a45f846-fece-4032-aaec-f5ce0d161af7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44c7b7e-df4e-4942-b02e-d1e95f987e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d44c7b7e-df4e-4942-b02e-d1e95f987e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74b3abd-9448-4330-b395-03476fc713a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:39 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Volume 7a45f846-fece-4032-aaec-f5ce0d161af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a45f846-fece-4032-aaec-f5ce0d161af7', 'volume_size': 1} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba58c1bd-0a09-4278-a795-7c62765296a8,created_at=2025-09-15T23:40:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-669064186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba58c1bd-0a09-4278-a795-7c62765296a8,host='devstack@QuobyteHD#QuobyteHD',id=7a45f846-fece-4032-aaec-f5ce0d161af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8297e2320aed46198901015aed00fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:39Z,use_quota=True,user_id='dde32884233043d6acea2cb725d58877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ac428f6-8fd5-4c99-bb19-f3d096a1453e),volume_type_id=8ac428f6-8fd5-4c99-bb19-f3d096a1453e)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Creating volume 7a45f846-fece-4032-aaec-f5ce0d161af7 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:40:39 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:40:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:39 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=41, name=volume-7a45f846-fece-4032-aaec-f5ce0d161af7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 1073741824" returned: 0 in 0.422s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7" returned: 0 in 0.178s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] <== create_volume: return (692ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d74b3abd-9448-4330-b395-03476fc713a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a45f846-fece-4032-aaec-f5ce0d161af7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadc1a38-eb66-453f-82d1-144fd65bb4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:40 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Volume volume-7a45f846-fece-4032-aaec-f5ce0d161af7 (7a45f846-fece-4032-aaec-f5ce0d161af7): created successfully Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eadc1a38-eb66-453f-82d1-144fd65bb4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Flow 'volume_create_manager' (88410600-2848-437a-84da-2883a4eb99a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f9aff900-3683-4221-b81d-bfd35dd98c4f tempest-GroupSnapshotsTest-957895633 None] Created volume successfully. Sep 16 01:40:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Flow 'volume_create_manager' (46b2f716-4889-4c7b-94bc-b84d1446ac7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a432a7-a44d-4a16-895d-d06a3291bc46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Flow 'volume_create_manager' (ff769a3e-6600-468f-a4fc-a23c5cdea90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a6d4ce-fdf3-467d-a903-0549c00d26eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3a432a7-a44d-4a16-895d-d06a3291bc46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1944871917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba58c1bd-0a09-4278-a795-7c62765296a8,host='devstack@QuobyteHD#QuobyteHD',id=95f9fdbb-e505-48a9-a437-c5bab1c5bd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8297e2320aed46198901015aed00fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:42Z,use_quota=True,user_id='dde32884233043d6acea2cb725d58877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ac428f6-8fd5-4c99-bb19-f3d096a1453e),volume_type_id=8ac428f6-8fd5-4c99-bb19-f3d096a1453e)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af33e19-289a-4b2a-b4be-a4f4a82917f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af33e19-289a-4b2a-b4be-a4f4a82917f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d82bbfa-c9f1-40c3-aa86-72eb1c6058dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d82bbfa-c9f1-40c3-aa86-72eb1c6058dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f9fdbb-e505-48a9-a437-c5bab1c5bd01', 'volume_name': 'volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a413f5-248b-44cd-b837-a51b07ccd6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a413f5-248b-44cd-b837-a51b07ccd6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2e9772-8083-46d9-90be-6fbe3f779274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Volume 95f9fdbb-e505-48a9-a437-c5bab1c5bd01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01', 'volume_size': 1} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ba58c1bd-0a09-4278-a795-7c62765296a8,created_at=2025-09-15T23:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1944871917',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ba58c1bd-0a09-4278-a795-7c62765296a8,host='devstack@QuobyteHD#QuobyteHD',id=95f9fdbb-e505-48a9-a437-c5bab1c5bd01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8297e2320aed46198901015aed00fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:42Z,use_quota=True,user_id='dde32884233043d6acea2cb725d58877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8ac428f6-8fd5-4c99-bb19-f3d096a1453e),volume_type_id=8ac428f6-8fd5-4c99-bb19-f3d096a1453e)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Creating volume 95f9fdbb-e505-48a9-a437-c5bab1c5bd01 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:40:42 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:42 devstack quobyte-client[83066]: System call of process 91582 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:42 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=42, name=volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a6d4ce-fdf3-467d-a903-0549c00d26eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-121219339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94458b0f-535b-467e-9f02-c6f2597bdbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d2c45d61cc4f9cb69adb08b0d24339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:42Z,use_quota=True,user_id='c4e406535b2540ebbee75599dee3ee99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fbfba4-89f1-456f-8e27-d867c5c7aea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fbfba4-89f1-456f-8e27-d867c5c7aea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63306fcf-3fde-432e-8e1d-996383bc97a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63306fcf-3fde-432e-8e1d-996383bc97a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94458b0f-535b-467e-9f02-c6f2597bdbce', 'volume_name': 'volume-94458b0f-535b-467e-9f02-c6f2597bdbce', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a3940e-4d6a-45ba-91f8-dde5102be57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a3940e-4d6a-45ba-91f8-dde5102be57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5723a973-b3f8-4bc5-ba54-716896412fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:42 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Volume 94458b0f-535b-467e-9f02-c6f2597bdbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94458b0f-535b-467e-9f02-c6f2597bdbce', 'volume_size': 1} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 1073741824" returned: 0 in 0.419s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" returned: 0 in 0.137s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] <== create_volume: return (605ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.617s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.336s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:40:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-121219339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94458b0f-535b-467e-9f02-c6f2597bdbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d2c45d61cc4f9cb69adb08b0d24339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:40:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:40:42Z,use_quota=True,user_id='c4e406535b2540ebbee75599dee3ee99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Creating volume 94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:40:43 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:43 devstack quobyte-client[83066]: System call of process 91586 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:43 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=43, name=volume-94458b0f-535b-467e-9f02-c6f2597bdbce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d2e9772-8083-46d9-90be-6fbe3f779274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fed12a2-2e43-4ccc-9007-1668ffbecfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce 1073741824" returned: 0 in 0.439s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:43 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Volume volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 (95f9fdbb-e505-48a9-a437-c5bab1c5bd01): created successfully Sep 16 01:40:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fed12a2-2e43-4ccc-9007-1668ffbecfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Flow 'volume_create_manager' (46b2f716-4889-4c7b-94bc-b84d1446ac7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dab88c4c-aae8-4849-9979-3bd809467b10 tempest-GroupSnapshotsTest-957895633 None] Created volume successfully. Sep 16 01:40:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce" returned: 0 in 0.375s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] <== create_volume: return (848ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:40:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5723a973-b3f8-4bc5-ba54-716896412fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94458b0f-535b-467e-9f02-c6f2597bdbce', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35fad5d-f52a-430c-872f-7da548ea0d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:40:44 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Volume volume-94458b0f-535b-467e-9f02-c6f2597bdbce (94458b0f-535b-467e-9f02-c6f2597bdbce): created successfully Sep 16 01:40:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b35fad5d-f52a-430c-872f-7da548ea0d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:40:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Flow 'volume_create_manager' (ff769a3e-6600-468f-a4fc-a23c5cdea90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:40:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3f962185-3c8d-4c52-8212-b6b637708406 tempest-VolumesDeleteCascade-1765319913 None] Created volume successfully. Sep 16 01:40:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ca94d01b-c856-4022-8373-f7671aae543c tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ca94d01b-c856-4022-8373-f7671aae543c tempest-GroupSnapshotsTest-957895633 None] Update group completed successfully. Sep 16 01:40:45 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Creating offline snapshot c134d5bd-86cc-47ff-a13e-662cb600a6ce of volume 94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:40:45 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef212c-11fb-45a7-87be-43b4290bf5f1]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:46 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-272a15a6-5cbc-43ea-84ec-207c26d10b07 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-272a15a6-5cbc-43ea-84ec-207c26d10b07 tempest-GroupSnapshotsTest-957895633 None] Update group completed successfully. Sep 16 01:40:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce" returned: 0 in 0.598s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:46 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=44, name=volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce 1G" returned: 0 in 0.271s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img rebase -u -b volume-94458b0f-535b-467e-9f02-c6f2597bdbce -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img rebase -u -b volume-94458b0f-535b-467e-9f02-c6f2597bdbce -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce" returned: 0 in 0.141s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce" returned: 0 in 0.442s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:40:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e08a846e-85d3-4dce-818e-b66f44f69a1e tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce" returned: 0 in 0.371s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.info" returned: 0 in 0.266s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:48 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e08a846e-85d3-4dce-818e-b66f44f69a1e tempest-GroupSnapshotsTest-957895633 None] Update group completed successfully. Sep 16 01:40:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.info" returned: 0 in 0.471s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.798s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:48 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2b0ee7ab-9f91-4ab8-b446-be7e5d8a07a3 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:48 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ebe519bb-f291-45d6-b6d3-c0a72152c09b tempest-VolumesDeleteCascade-1765319913 None] Create snapshot completed successfully Sep 16 01:40:48 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2b0ee7ab-9f91-4ab8-b446-be7e5d8a07a3 tempest-GroupSnapshotsTest-957895633 None] Update group completed successfully. Sep 16 01:40:49 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Creating offline snapshot deef076b-25d2-414a-9ba5-3687c93ed8d1 of volume 94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:40:49 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e87b044-59b2-4b81-9b79-a0e253701dc9]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce" returned: 0 in 0.653s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94458b0f-535b-467e-9f02-c6f2597bdbce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:40:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:50 devstack quobyte-client[83066]: System call of process 91611 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:50 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=46, name=volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] GroupSnapshot 538753cf-3d59-4a50-b126-07a1938c6dae: creating. Sep 16 01:40:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 1G" returned: 0 in 0.743s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img rebase -u -b volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:50 devstack quobyte-client[83066]: System call of process 91614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:51 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Group snapshot 538753cf-3d59-4a50-b126-07a1938c6dae: creating. {{(pid=83041) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 01:40:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img rebase -u -b volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1" returned: 0 in 0.632s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1" returned: 0 in 0.919s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:40:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1" returned: 0 in 0.221s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.599s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.273s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Creating offline snapshot 530d35ed-30da-4ade-92f0-da4e6453172f of volume 95f9fdbb-e505-48a9-a437-c5bab1c5bd01 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:40:53 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-98dc3233-43a7-48de-a359-2d73a693e1af tempest-VolumesDeleteCascade-1765319913 None] Create snapshot completed successfully Sep 16 01:40:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7af9ca-dc5c-4564-a942-62c0b865be75]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-94458b0f-535b-467e-9f02-c6f2597bdbce-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" returned: 0 in 0.793s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-94458b0f-535b-467e-9f02-c6f2597bdbce-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:54 devstack quobyte-client[83066]: System call of process 91657 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:54 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=47, name=volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f 1G" returned: 0 in 0.387s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:54 devstack quobyte-client[83066]: System call of process 91660 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:40:55 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Performing cascade delete. {{(pid=83041) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 01:40:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-c134d5bd-86cc-47ff-a13e-662cb600a6ce-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img rebase -u -b volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f" returned: 0 in 0.859s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-c134d5bd-86cc-47ff-a13e-662cb600a6ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.346s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:55 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f" returned: 0 in 0.663s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" acquired by "delete_snapshot" :: waited 0.235s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-c134d5bd-86cc-47ff-a13e-662cb600a6ce" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f" returned: 0 in 0.277s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-c134d5bd-86cc-47ff-a13e-662cb600a6ce" acquired by "_delete_snapshot" :: waited 0.261s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Deleting offline snapshot c134d5bd-86cc-47ff-a13e-662cb600a6ce of volume 94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] snapshot_file for this snap is: volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f114a43-6c68-40c4-b861-dfb6dd9694f9]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.info" returned: 0 in 0.433s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.info" returned: 0 in 0.194s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.140s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Creating offline snapshot c7c8dd81-38c8-479c-934d-3ddee6dd5e1c of volume 7a45f846-fece-4032-aaec-f5ce0d161af7 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce" returned: 0 in 0.757s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94458b0f-535b-467e-9f02-c6f2597bdbce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[821fde07-8f67-47fe-bf5c-0167632fca0b]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b3d259-53d8-48be-91fc-b880a8364335]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7" returned: 0 in 0.483s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce" returned: 0 in 0.583s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:58 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=49, name=volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c71e3b7-07dd-4d7d-9b45-0c929a251eb3]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c 1G" returned: 0 in 0.355s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7a45f846-fece-4032-aaec-f5ce0d161af7 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img rebase -u -b volume-7a45f846-fece-4032-aaec-f5ce0d161af7 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" returned: 0 in 0.160s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" returned: 0 in 0.143s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:40:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1" returned: 0 in 0.610s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94458b0f-535b-467e-9f02-c6f2597bdbce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2cd16a-45be-4e07-9f1e-a6333a67d8bb]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" returned: 0 in 0.262s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.info" returned: 0 in 0.147s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.info" returned: 0 in 0.100s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce" returned: 0 in 0.731s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94458b0f-535b-467e-9f02-c6f2597bdbce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb740e0a-2954-437b-8cc9-7b5221299760]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:40:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ec13de5e-b59f-4d85-90a3-39212162aa47 tempest-GroupSnapshotsTest-957895633 None] group_snapshot 538753cf-3d59-4a50-b126-07a1938c6dae: created successfully Sep 16 01:41:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce" returned: 0 in 0.633s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce" returned: 0 in 0.199s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.c134d5bd-86cc-47ff-a13e-662cb600a6ce" returned: 0 in 0.088s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img rebase -u -b volume-94458b0f-535b-467e-9f02-c6f2597bdbce /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 -F qcow2 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img rebase -u -b volume-94458b0f-535b-467e-9f02-c6f2597bdbce /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 -F qcow2" returned: 0 in 0.124s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-c134d5bd-86cc-47ff-a13e-662cb600a6ce" released by "_delete_snapshot" :: held 4.416s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" released by "delete_snapshot" :: held 4.735s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] group_snapshot 538753cf-3d59-4a50-b126-07a1938c6dae: deleting Sep 16 01:41:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] group_snapshot 538753cf-3d59-4a50-b126-07a1938c6dae: deleting {{(pid=83041) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Created reservations ['9b41af78-ffdc-4f73-a41d-396a73c04de0', '5f925b78-0a1a-40b1-8de1-7811e027f8a9', '23e4e17c-07c2-46ac-939e-095cf1465025', '47767963-0249-4bd0-bb66-c69800ab0b87'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" acquired by "delete_snapshot" :: waited 0.038s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-530d35ed-30da-4ade-92f0-da4e6453172f" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-530d35ed-30da-4ade-92f0-da4e6453172f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Deleting offline snapshot 530d35ed-30da-4ade-92f0-da4e6453172f of volume 95f9fdbb-e505-48a9-a437-c5bab1c5bd01 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] snapshot_file for this snap is: volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0da2a8a-fb8e-4ed2-8b3d-bf673b091e11]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Delete snapshot completed successfully. Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-c134d5bd-86cc-47ff-a13e-662cb600a6ce-delete_snapshot" released by "delete_snapshot" :: held 6.354s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-deef076b-25d2-414a-9ba5-3687c93ed8d1-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-deef076b-25d2-414a-9ba5-3687c93ed8d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:02 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:02 devstack quobyte-client[83066]: System call of process 91704 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f" returned: 0 in 0.658s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b8b1ed-7c8b-47ff-8a82-45ad04d47b56]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" acquired by "delete_snapshot" :: waited 0.173s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-deef076b-25d2-414a-9ba5-3687c93ed8d1" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-deef076b-25d2-414a-9ba5-3687c93ed8d1" acquired by "_delete_snapshot" :: waited 0.059s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Deleting offline snapshot deef076b-25d2-414a-9ba5-3687c93ed8d1 of volume 94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] snapshot_file for this snap is: volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[811d28b7-8073-4397-9f2f-0417a94609f4]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" returned: 0 in 0.711s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1" returned: 0 in 0.585s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94458b0f-535b-467e-9f02-c6f2597bdbce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d43650-3488-4b5b-8ee3-253d62504efd]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f" returned: 0 in 0.306s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01.530d35ed-30da-4ade-92f0-da4e6453172f" returned: 0 in 0.117s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-530d35ed-30da-4ade-92f0-da4e6453172f" released by "_delete_snapshot" :: held 2.112s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" released by "delete_snapshot" :: held 2.149s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-7a45f846-fece-4032-aaec-f5ce0d161af7" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce" returned: 0 in 0.637s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:04 devstack quobyte-client[83066]: System call of process 91721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-7a45f846-fece-4032-aaec-f5ce0d161af7" acquired by "delete_snapshot" :: waited 0.184s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1" returned: 0 in 0.223s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" acquired by "_delete_snapshot" :: waited 0.151s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Deleting offline snapshot c7c8dd81-38c8-479c-934d-3ddee6dd5e1c of volume 7a45f846-fece-4032-aaec-f5ce0d161af7 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] snapshot_file for this snap is: volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa215785-3fc6-4f50-ac7d-6e01dd71242c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce.deef076b-25d2-414a-9ba5-3687c93ed8d1" returned: 0 in 0.442s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.338s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-deef076b-25d2-414a-9ba5-3687c93ed8d1" released by "_delete_snapshot" :: held 2.352s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" released by "delete_snapshot" :: held 2.475s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Created reservations ['7e20579f-d07d-4ea9-b9ff-8e7e97c6a695', '1d1a8d4d-2006-4084-b628-137ead9b6fbf', 'a7cedd14-be91-4612-9e72-750ba883fe4e', '71625696-821d-4751-853e-73893e939aa3'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" returned: 0 in 0.750s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a45f846-fece-4032-aaec-f5ce0d161af7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[434fc08c-cc99-44c1-8036-42ce24765ec9]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:05 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Delete snapshot completed successfully. Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-deef076b-25d2-414a-9ba5-3687c93ed8d1-delete_snapshot" released by "delete_snapshot" :: held 3.804s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Snapshots deleted, issuing volume delete {{(pid=83041) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" acquired by "delete_volume" :: waited 0.024s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d110cb1-f7f9-42a8-9284-9eafe14e56bd]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7" returned: 0 in 0.638s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:06 devstack quobyte-client[83066]: System call of process 91737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" returned: 0 in 0.211s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce" returned: 0 in 0.532s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7.c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" returned: 0 in 0.175s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-c7c8dd81-38c8-479c-934d-3ddee6dd5e1c" released by "_delete_snapshot" :: held 2.285s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-94458b0f-535b-467e-9f02-c6f2597bdbce" returned: 0 in 0.179s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-7a45f846-fece-4032-aaec-f5ce0d161af7" released by "delete_snapshot" :: held 2.502s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:06 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-94458b0f-535b-467e-9f02-c6f2597bdbce" released by "delete_volume" :: held 0.945s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:07 devstack cinder-volume[83041]: WARNING cinder.quota [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1059818334 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1059818334, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:41:07 devstack cinder-volume[83041]: WARNING cinder.quota [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1059818334 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1059818334, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Created reservations ['15429329-eaaa-47f1-a2e7-53f94349bd30', '1bc2bf31-7a6e-4a29-be4d-18eedc177d5c', '4222b8a4-a90c-4df5-9e6a-e0e59cab521b', '1759e7b0-924f-498b-b747-4a06ff9e9e2b'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Created reservations ['6f5cd9a8-59c4-47bc-b2bd-1fd4b757e5c2', 'd46e442b-35ca-409e-baad-681307297378', '1017171b-9a84-45f4-a8c5-404acea53768', 'a4dfdc3d-affb-4d51-8a3d-26569c6ff8b8'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.350s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:07 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:41:07 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Deleted volume successfully. Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d88551ff-9278-45f6-ad3c-221130f24db8 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-94458b0f-535b-467e-9f02-c6f2597bdbce-delete_volume" released by "delete_volume" :: held 14.035s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] Created reservations ['9d79a84b-c641-43bd-bbf3-727baba086d0', '8addd3ea-75a6-4b4b-bf79-3cff69dfe2fc', '4ec1f11a-5882-4254-a11f-cbae1594bce6', 'ba1f1259-8df1-4a17-85ba-819bec415809'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:08 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6b5fa05b-9de9-4938-bc09-c8052fbcca41 tempest-GroupSnapshotsTest-957895633 None] group_snapshot 538753cf-3d59-4a50-b126-07a1938c6dae: deleted successfully Sep 16 01:41:08 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Flow 'volume_create_manager' (6223e7f0-33fa-4ec9-8884-f16fd041faf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fd1ef7-048d-4bd6-b24f-d6ddf5d6a096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65fd1ef7-048d-4bd6-b24f-d6ddf5d6a096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2057558486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75af95a7-ffd3-48d4-8abe-3e8d36538d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d2c45d61cc4f9cb69adb08b0d24339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:08Z,use_quota=True,user_id='c4e406535b2540ebbee75599dee3ee99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db19ab9e-0b03-48db-a2e9-077d1ebd1e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db19ab9e-0b03-48db-a2e9-077d1ebd1e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9062ce13-1401-44b9-81cb-1bd9b7cfea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9062ce13-1401-44b9-81cb-1bd9b7cfea81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75af95a7-ffd3-48d4-8abe-3e8d36538d7f', 'volume_name': 'volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9457c187-07a4-446d-b0f2-abe54bc233eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9457c187-07a4-446d-b0f2-abe54bc233eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14ed5c8-03ed-4cb2-a927-f0d79b789dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:08 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Volume 75af95a7-ffd3-48d4-8abe-3e8d36538d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f', 'volume_size': 1} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2057558486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75af95a7-ffd3-48d4-8abe-3e8d36538d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d2c45d61cc4f9cb69adb08b0d24339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:08Z,use_quota=True,user_id='c4e406535b2540ebbee75599dee3ee99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Creating volume 75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:41:08 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:41:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:08 devstack quobyte-client[83066]: System call of process 91745 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:08 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=51, name=volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f 1073741824" returned: 0 in 0.317s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" returned: 0 in 0.083s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] <== create_volume: return (474ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.487s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f14ed5c8-03ed-4cb2-a927-f0d79b789dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad67bd1-4736-49c8-a48e-2662cf807ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:09 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Volume volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f (75af95a7-ffd3-48d4-8abe-3e8d36538d7f): created successfully Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fad67bd1-4736-49c8-a48e-2662cf807ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Flow 'volume_create_manager' (6223e7f0-33fa-4ec9-8884-f16fd041faf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-90ff5f7b-ff83-409c-83cd-e5f4022f74de tempest-VolumesDeleteCascade-1765319913 None] Created volume successfully. Sep 16 01:41:09 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-7a45f846-fece-4032-aaec-f5ce0d161af7" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-7a45f846-fece-4032-aaec-f5ce0d161af7" acquired by "delete_volume" :: waited 0.053s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2499c1-15b7-45ea-83d5-f1835637e187]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7" returned: 0 in 0.419s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7a45f846-fece-4032-aaec-f5ce0d161af7" returned: 0 in 0.100s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-7a45f846-fece-4032-aaec-f5ce0d161af7" released by "delete_volume" :: held 0.671s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" acquired by "delete_volume" :: waited 0.029s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:10 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bfbfc5-f6aa-43f2-ad12-a8372df09a64]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" returned: 0 in 0.592s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" returned: 0 in 0.302s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Creating offline snapshot 8dfdba82-2446-4222-bba8-d50214a6f0bc of volume 75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb704b1-6eff-4737-8af3-c74b995930ab]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-95f9fdbb-e505-48a9-a437-c5bab1c5bd01" released by "delete_volume" :: held 1.125s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Created reservations ['3adc4366-299f-4831-8e7e-2abdceb04dd7'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" returned: 0 in 0.577s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:12 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=52, name=volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:12 devstack cinder-volume[83041]: WARNING cinder.quota [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1059818334 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1059818334, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc 1G" returned: 0 in 0.355s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img rebase -u -b volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img rebase -u -b volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc" returned: 0 in 0.179s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc" returned: 0 in 0.125s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:12 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Created reservations ['03c7656b-725a-4e83-82b8-a9dd685f18f6', 'bb9ea0b1-9b87-43e7-8e6c-8ff86717d86a', 'b5e01753-85a0-454a-9065-7af1d07fe8ba', '07c3ae7f-10ef-478d-8fcc-71d5a6448fcb'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc" returned: 0 in 0.320s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.info" returned: 0 in 0.285s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:41:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.info" returned: 0 in 0.262s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.425s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:13 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-a55fb45d-c2ca-43f0-b07b-54c9a5d8f27e tempest-VolumesDeleteCascade-1765319913 None] Create snapshot completed successfully Sep 16 01:41:13 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Created reservations ['4118fad5-f142-4407-aed4-3e1d0a3af499', '815db6b3-90cb-4f66-b430-ed3627300d15', '08acc4c4-fa43-42d6-849e-2310a12ee06a', '8bcfd27a-902f-48fb-b541-6c1d78731035'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.117s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:41:14 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-cbecca9b-7776-4011-bf84-eb5141d170bd tempest-GroupSnapshotsTest-957895633 None] Delete group completed successfully. Sep 16 01:41:14 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:14 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:41:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-35ad76a2-a0e7-4073-adad-7b49a9747b41 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:15 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-35ad76a2-a0e7-4073-adad-7b49a9747b41 tempest-GroupSnapshotsTest-957895633 None] Group tempest-GroupSnapshotsTest-Group-520681269: creating Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Flow 'volume_create_manager' (05b520ba-c4c4-495b-9af5-3fd6618a4f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5817e3-b3f2-4764-a1f4-5a776d3ff60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5817e3-b3f2-4764-a1f4-5a776d3ff60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1678846611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a9d615-6c25-472e-988d-03bf3c3b4245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53d2c45d61cc4f9cb69adb08b0d24339',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8dfdba82-2446-4222-bba8-d50214a6f0bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:15Z,use_quota=True,user_id='c4e406535b2540ebbee75599dee3ee99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf6e4df-f395-4ba3-873b-3d0552c42f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcf6e4df-f395-4ba3-873b-3d0552c42f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3296cc7a-9005-4777-b84e-f1bb29488f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3296cc7a-9005-4777-b84e-f1bb29488f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '01a9d615-6c25-472e-988d-03bf3c3b4245', 'volume_name': 'volume-01a9d615-6c25-472e-988d-03bf3c3b4245', 'volume_size': 1, 'snapshot_id': '8dfdba82-2446-4222-bba8-d50214a6f0bc'}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c7d4f4-9697-4eac-8be6-0a8af0199c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24c7d4f4-9697-4eac-8be6-0a8af0199c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8980985d-0be0-4b61-9d36-c140ce0d74c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:15 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Volume 01a9d615-6c25-472e-988d-03bf3c3b4245: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-01a9d615-6c25-472e-988d-03bf3c3b4245', 'volume_size': 1, 'snapshot_id': '8dfdba82-2446-4222-bba8-d50214a6f0bc'} Sep 16 01:41:15 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-35ad76a2-a0e7-4073-adad-7b49a9747b41 tempest-GroupSnapshotsTest-957895633 None] Group tempest-GroupSnapshotsTest-Group-520681269: created successfully Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-8dfdba82-2446-4222-bba8-d50214a6f0bc-01a9d615-6c25-472e-988d-03bf3c3b4245" by "_create_volume_from_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:15 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-35ad76a2-a0e7-4073-adad-7b49a9747b41 tempest-GroupSnapshotsTest-957895633 None] Create group completed successfully. Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-8dfdba82-2446-4222-bba8-d50214a6f0bc-01a9d615-6c25-472e-988d-03bf3c3b4245" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Creating volume 01a9d615-6c25-472e-988d-03bf3c3b4245 from snapshot 8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-01a9d615-6c25-472e-988d-03bf3c3b4245" by "_copy_volume_from_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-01a9d615-6c25-472e-988d-03bf3c3b4245" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] snapshot: 8dfdba82-2446-4222-bba8-d50214a6f0bc, volume: 01a9d615-6c25-472e-988d-03bf3c3b4245, {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebc29c6-1ffc-478a-a4b4-1a5d03ae00f3]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc" returned: 0 in 0.376s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Creating direct copy from snapshot {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a67fb4-2028-4b76-870e-3f6d0cc867d6]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" returned: 0 in 0.419s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:16 devstack cinder-volume[83041]: DEBUG cinder.utils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245 not found in is_blk_device check {{(pid=83041) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 01:41:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:16 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=54, name=volume-01a9d615-6c25-472e-988d-03bf3c3b4245, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:16 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:16 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Flow 'volume_create_manager' (c54de627-ad0c-4526-92e1-d3625d076ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8649d6a6-7a27-457a-9b92-9475a7da89c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8649d6a6-7a27-457a-9b92-9475a7da89c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451042479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ead435cb-fb90-45c3-bec4-da52baf8f0c4,host='devstack@QuobyteHD#QuobyteHD',id=fe8188f2-bd58-4734-af5c-40128ea63850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8297e2320aed46198901015aed00fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:16Z,use_quota=True,user_id='dde32884233043d6acea2cb725d58877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192991e0-321c-4a4c-8f97-e41ea9db4553),volume_type_id=192991e0-321c-4a4c-8f97-e41ea9db4553)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929d3ad2-f69b-404c-a579-1149b51f79ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929d3ad2-f69b-404c-a579-1149b51f79ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e7775f-64a1-4147-a783-7e59261fe8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e7775f-64a1-4147-a783-7e59261fe8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8188f2-bd58-4734-af5c-40128ea63850', 'volume_name': 'volume-fe8188f2-bd58-4734-af5c-40128ea63850', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4765ab85-6700-4187-a747-bc748b5848b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4765ab85-6700-4187-a747-bc748b5848b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97addb71-fd9a-4604-b77c-c6ec3f1d94a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:17 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Volume fe8188f2-bd58-4734-af5c-40128ea63850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8188f2-bd58-4734-af5c-40128ea63850', 'volume_size': 1} Sep 16 01:41:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245" returned: 0 in 5.328s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:21 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1f9185-2a91-4c59-b2d4-345c52e8c984]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" returned: 0 in 0.514s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245 {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:41:22 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Converted 1024.00 MB image at 192.02 MB/s Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245" returned: 0 in 0.153s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-01a9d615-6c25-472e-988d-03bf3c3b4245" released by "_copy_volume_from_snapshot" :: held 7.099s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-8dfdba82-2446-4222-bba8-d50214a6f0bc-01a9d615-6c25-472e-988d-03bf3c3b4245" released by "_create_volume_from_snapshot" :: held 7.134s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.159s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.166s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ead435cb-fb90-45c3-bec4-da52baf8f0c4,created_at=2025-09-15T23:41:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-451042479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ead435cb-fb90-45c3-bec4-da52baf8f0c4,host='devstack@QuobyteHD#QuobyteHD',id=fe8188f2-bd58-4734-af5c-40128ea63850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8297e2320aed46198901015aed00fbbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:16Z,use_quota=True,user_id='dde32884233043d6acea2cb725d58877',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(192991e0-321c-4a4c-8f97-e41ea9db4553),volume_type_id=192991e0-321c-4a4c-8f97-e41ea9db4553)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Creating volume fe8188f2-bd58-4734-af5c-40128ea63850 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:41:22 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:22 devstack quobyte-client[83066]: System call of process 91824 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:22 devstack quobyte-client[83066]: System call of process 91824 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:22 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=55, name=volume-fe8188f2-bd58-4734-af5c-40128ea63850, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 1073741824" returned: 0 in 0.391s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8980985d-0be0-4b61-9d36-c140ce0d74c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a9d615-6c25-472e-988d-03bf3c3b4245', 'volume_size': 1, 'snapshot_id': '8dfdba82-2446-4222-bba8-d50214a6f0bc'}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c03c637-317e-481b-811b-d28c61813f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850" returned: 0 in 0.303s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] <== create_volume: return (735ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:23 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Volume volume-01a9d615-6c25-472e-988d-03bf3c3b4245 (01a9d615-6c25-472e-988d-03bf3c3b4245): created successfully Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c03c637-317e-481b-811b-d28c61813f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Flow 'volume_create_manager' (05b520ba-c4c4-495b-9af5-3fd6618a4f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97addb71-fd9a-4604-b77c-c6ec3f1d94a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8188f2-bd58-4734-af5c-40128ea63850', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69b2019-1345-44c2-99f1-fea98c278c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:23 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Volume volume-fe8188f2-bd58-4734-af5c-40128ea63850 (fe8188f2-bd58-4734-af5c-40128ea63850): created successfully Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f69b2019-1345-44c2-99f1-fea98c278c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Flow 'volume_create_manager' (c54de627-ad0c-4526-92e1-d3625d076ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:23 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2395ad55-b097-4fbc-b99f-ca3315a32906 tempest-GroupSnapshotsTest-957895633 None] Created volume successfully. Sep 16 01:41:23 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3a1a5842-2e39-41cf-923b-1a811193f187 tempest-VolumesDeleteCascade-1765319913 None] Created volume successfully. Sep 16 01:41:24 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] GroupSnapshot ec635a28-7712-49d5-8358-baf1c42ffb08: creating. Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-75af95a7-ffd3-48d4-8abe-3e8d36538d7f-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Group snapshot ec635a28-7712-49d5-8358-baf1c42ffb08: creating. {{(pid=83041) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-75af95a7-ffd3-48d4-8abe-3e8d36538d7f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Creating offline snapshot a8609af1-abc2-4352-bb71-255e20c4dcb8 of volume fe8188f2-bd58-4734-af5c-40128ea63850 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:41:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Performing cascade delete. {{(pid=83041) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d4737c-5a23-4d0e-adf6-5523b403a313]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-8dfdba82-2446-4222-bba8-d50214a6f0bc-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-8dfdba82-2446-4222-bba8-d50214a6f0bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-8dfdba82-2446-4222-bba8-d50214a6f0bc" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-8dfdba82-2446-4222-bba8-d50214a6f0bc" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Deleting offline snapshot 8dfdba82-2446-4222-bba8-d50214a6f0bc of volume 75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] snapshot_file for this snap is: volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4e8139-b761-483c-9709-0eb597abbdbb]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850" returned: 0 in 0.600s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:25 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=56, name=volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 1G" returned: 0 in 0.270s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img rebase -u -b volume-fe8188f2-bd58-4734-af5c-40128ea63850 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc" returned: 0 in 0.552s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1895ebe6-42bb-455f-b277-b809efc1c699]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img rebase -u -b volume-fe8188f2-bd58-4734-af5c-40128ea63850 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8" returned: 0 in 0.238s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8" returned: 0 in 0.105s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8" returned: 0 in 0.141s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-03d3d70d-7ed3-4469-bee7-3521958d3ab1 req-b6828133-6137-483a-8742-395f0add94d7 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.info" returned: 0 in 0.440s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" returned: 0 in 1.053s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-03d3d70d-7ed3-4469-bee7-3521958d3ab1 req-b6828133-6137-483a-8742-395f0add94d7 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:26 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-03d3d70d-7ed3-4469-bee7-3521958d3ab1 req-b6828133-6137-483a-8742-395f0add94d7 tempest-AttachVolumeNegativeTest-678661232 None] Terminate volume connection completed successfully. Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-03d3d70d-7ed3-4469-bee7-3521958d3ab1 req-b6828133-6137-483a-8742-395f0add94d7 tempest-AttachVolumeNegativeTest-678661232 None] Deleting attachment 8e069bf6-b77a-43d7-b029-8bfc73ebd4d6. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.info" returned: 0 in 0.342s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:26 devstack quobyte-client[83066]: System call of process 91851 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc" returned: 0 in 0.373s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f.8dfdba82-2446-4222-bba8-d50214a6f0bc" returned: 0 in 0.286s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-8dfdba82-2446-4222-bba8-d50214a6f0bc" released by "_delete_snapshot" :: held 2.606s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" released by "delete_snapshot" :: held 2.698s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6d3c3f8d-0d6d-45f3-a126-dc3924ab9711 tempest-GroupSnapshotsTest-957895633 None] group_snapshot ec635a28-7712-49d5-8358-baf1c42ffb08: created successfully Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Created reservations ['0e5330ba-40e8-4fff-b0b5-38e998b0da8b', 'ffe28814-fff3-4dce-a28c-b4146faa750b', '48197094-3830-4bf5-ab2a-d63b286d5a57', '56032a42-0a01-47e9-ac93-b8d7dd7e90da'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Delete snapshot completed successfully. Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-8dfdba82-2446-4222-bba8-d50214a6f0bc-delete_snapshot" released by "delete_snapshot" :: held 3.098s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Snapshots deleted, issuing volume delete {{(pid=83041) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" acquired by "delete_volume" :: waited 0.031s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55db667-3ba1-4b2d-b632-f0d464a3578b]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:28 devstack quobyte-client[83066]: System call of process 91862 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" returned: 0 in 0.555s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" returned: 0 in 0.144s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-75af95a7-ffd3-48d4-8abe-3e8d36538d7f" released by "delete_volume" :: held 0.927s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] group_snapshot ec635a28-7712-49d5-8358-baf1c42ffb08: deleting Sep 16 01:41:29 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] group_snapshot ec635a28-7712-49d5-8358-baf1c42ffb08: deleting {{(pid=83041) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-fe8188f2-bd58-4734-af5c-40128ea63850" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-fe8188f2-bd58-4734-af5c-40128ea63850" acquired by "delete_snapshot" :: waited 0.024s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-a8609af1-abc2-4352-bb71-255e20c4dcb8" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Created reservations ['2e27dacc-f909-41bc-bf51-bb0959f4de5f', 'c8cd5ebd-62f0-4622-8dc9-61a29afca387', 'f04a4781-a51d-4e26-abd1-6b952321a230', 'c40cdf94-bb4a-4a27-bb41-e356525f4843'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-a8609af1-abc2-4352-bb71-255e20c4dcb8" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Deleting offline snapshot a8609af1-abc2-4352-bb71-255e20c4dcb8 of volume fe8188f2-bd58-4734-af5c-40128ea63850 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] snapshot_file for this snap is: volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c1221e-264a-4f42-9f13-bb48b66c3546]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8" returned: 0 in 1.663s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe8188f2-bd58-4734-af5c-40128ea63850(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9560b5-8415-42c5-8308-1a88a80a347f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-01a9d615-6c25-472e-988d-03bf3c3b4245-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.554s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-01a9d615-6c25-472e-988d-03bf3c3b4245-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:31 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:41:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Deleted volume successfully. Sep 16 01:41:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-90b037f7-11fd-4cf7-ba19-f853a43c3eb2 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-75af95a7-ffd3-48d4-8abe-3e8d36538d7f-delete_volume" released by "delete_volume" :: held 7.787s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:32 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "cinder-quobyte-01a9d615-6c25-472e-988d-03bf3c3b4245" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850" returned: 0 in 1.010s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-01a9d615-6c25-472e-988d-03bf3c3b4245" acquired by "delete_volume" :: waited 0.503s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:32 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bca94d-d757-4d20-b6ab-5d361412b5f2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8" returned: 0 in 0.654s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850.a8609af1-abc2-4352-bb71-255e20c4dcb8" returned: 0 in 0.428s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-a8609af1-abc2-4352-bb71-255e20c4dcb8" released by "_delete_snapshot" :: held 4.565s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-fe8188f2-bd58-4734-af5c-40128ea63850" released by "delete_snapshot" :: held 4.635s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245" returned: 0 in 1.391s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-01a9d615-6c25-472e-988d-03bf3c3b4245" returned: 0 in 0.735s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-quobyte-01a9d615-6c25-472e-988d-03bf3c3b4245" released by "delete_volume" :: held 2.512s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:35 devstack cinder-volume[83041]: WARNING cinder.quota [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1616801567 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1616801567, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:41:35 devstack cinder-volume[83041]: WARNING cinder.quota [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1616801567 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1616801567, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] Created reservations ['d3d537bb-38b0-42f4-91e7-a1e7567f7caa', 'ef800fc1-9cd0-4b33-845c-d7e67af47578', 'e365133f-8772-4fff-a8b6-a498ad17d01b', 'f02b53b0-05e3-4ac5-b1cb-10c9ab81516c'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Created reservations ['ab3c77ce-644c-4648-be6f-2feb36ab32b1', '2e92ce94-1a2b-4888-930d-c57864927c17', '62304f74-0da3-49d9-887f-86df3127bafc', 'bc4c8740-0f23-4062-9764-f45c6f9f1b36'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:35 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2a761e9b-2714-49ef-a4dd-62f89b0dc022 tempest-GroupSnapshotsTest-957895633 None] group_snapshot ec635a28-7712-49d5-8358-baf1c42ffb08: deleted successfully Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.174s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:35 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:41:36 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Deleted volume successfully. Sep 16 01:41:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb018cba-b95c-4ac5-b8a2-6fb1f891ed41 tempest-VolumesDeleteCascade-1765319913 None] Lock "cinder-01a9d615-6c25-472e-988d-03bf3c3b4245-delete_volume" released by "delete_volume" :: held 4.592s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "cinder-quobyte-fe8188f2-bd58-4734-af5c-40128ea63850" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-fe8188f2-bd58-4734-af5c-40128ea63850" acquired by "delete_volume" :: waited 0.021s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3cfd33-a2e5-4240-9e08-cdaf92efca56]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850" returned: 0 in 0.694s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-fe8188f2-bd58-4734-af5c-40128ea63850" returned: 0 in 0.104s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Lock "cinder-quobyte-fe8188f2-bd58-4734-af5c-40128ea63850" released by "delete_volume" :: held 1.012s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=99,cinder:UPDATE=110,cinder:DELETE=6,cinder:INSERT=17 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=97,cinder:SELECT=101,cinder:DELETE=6,cinder:INSERT=28 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Created reservations ['916b24cf-e4ed-40a3-a47e-e41fea4b6f3c'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:38 devstack cinder-volume[83041]: WARNING cinder.quota [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1616801567 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1616801567, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Created reservations ['b7d2fa3f-af16-4459-95c9-7e69a5b8a859', 'a469b4cd-613b-4a91-97ea-506886a902bd', 'e3b2348b-399e-4912-9a63-7d414e6e5323', '13ecaab2-0eb5-4d75-82d7-7237a9c6b6ed'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.199s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:39 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:41:39 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5283bea1-31b0-4673-92aa-cd8a291f13e8 tempest-GroupSnapshotsTest-957895633 None] Delete group completed successfully. Sep 16 01:41:43 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Flow 'volume_create_manager' (3c2033e5-3e60-44f4-9cef-bfab1bc48528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb8a7bd-c286-4fd3-81e4-2a016d6707cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb8a7bd-c286-4fd3-81e4-2a016d6707cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-436037371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fc3947-149e-4fa6-81f0-3d93070d3dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdad1cf32854d4c8740e9ad3d1c217f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:43Z,use_quota=True,user_id='4808fe572bec4649ae9f87a651ca9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc7dd50-30a7-4d2a-aea2-bdac489fa01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc7dd50-30a7-4d2a-aea2-bdac489fa01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818de400-129e-4a25-84b6-d0d878b538ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (818de400-129e-4a25-84b6-d0d878b538ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1fc3947-149e-4fa6-81f0-3d93070d3dac', 'volume_name': 'volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dad5b34-ce5a-44ee-be3e-e6d57768f9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dad5b34-ce5a-44ee-be3e-e6d57768f9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242cff33-799c-4d60-9875-83db37632a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:43 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Volume c1fc3947-149e-4fa6-81f0-3d93070d3dac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac', 'volume_size': 1} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-436037371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1fc3947-149e-4fa6-81f0-3d93070d3dac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdad1cf32854d4c8740e9ad3d1c217f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:43Z,use_quota=True,user_id='4808fe572bec4649ae9f87a651ca9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Creating volume c1fc3947-149e-4fa6-81f0-3d93070d3dac {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:41:43 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:43 devstack quobyte-client[83066]: System call of process 91942 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:43 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=58, name=volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac 1073741824" returned: 0 in 0.466s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac" returned: 0 in 0.133s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] <== create_volume: return (716ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:41:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (242cff33-799c-4d60-9875-83db37632a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a6c7b5-d534-4c65-a005-6ea67bb07643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:44 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Volume volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac (c1fc3947-149e-4fa6-81f0-3d93070d3dac): created successfully Sep 16 01:41:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79a6c7b5-d534-4c65-a005-6ea67bb07643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Flow 'volume_create_manager' (3c2033e5-3e60-44f4-9cef-bfab1bc48528) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-551e1e07-4d5a-41b3-9d05-775c585ffbc5 tempest-VolumesTransfersV355Test-1457732776 None] Created volume successfully. Sep 16 01:41:46 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e72a6744-1dae-4849-98c8-650a69eb6f1d tempest-VolumesTransfersV355Test-99707724 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e72a6744-1dae-4849-98c8-650a69eb6f1d tempest-VolumesTransfersV355Test-99707724 None] Transfer volume completed successfully. Sep 16 01:41:46 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-b131714f-2bf3-4f11-8aa6-81e34d5a5948 tempest-GroupSnapshotsV319Test-2141121015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b131714f-2bf3-4f11-8aa6-81e34d5a5948 tempest-GroupSnapshotsV319Test-2141121015 None] Group tempest-GroupSnapshotsV319Test-Group-866954754: creating Sep 16 01:41:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b131714f-2bf3-4f11-8aa6-81e34d5a5948 tempest-GroupSnapshotsV319Test-2141121015 None] Group tempest-GroupSnapshotsV319Test-Group-866954754: created successfully Sep 16 01:41:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b131714f-2bf3-4f11-8aa6-81e34d5a5948 tempest-GroupSnapshotsV319Test-2141121015 None] Create group completed successfully. Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Acquiring lock "cinder-c1fc3947-149e-4fa6-81f0-3d93070d3dac-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Lock "cinder-c1fc3947-149e-4fa6-81f0-3d93070d3dac-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Acquiring lock "cinder-quobyte-c1fc3947-149e-4fa6-81f0-3d93070d3dac" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Lock "cinder-quobyte-c1fc3947-149e-4fa6-81f0-3d93070d3dac" acquired by "delete_volume" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d276aa9-0591-4d46-b416-82dc6c13bd5f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac" returned: 0 in 0.422s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c1fc3947-149e-4fa6-81f0-3d93070d3dac" returned: 0 in 0.117s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Lock "cinder-quobyte-c1fc3947-149e-4fa6-81f0-3d93070d3dac" released by "delete_volume" :: held 0.709s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Created reservations ['cb9429c8-6c4e-4964-ab8c-885c14e7544b', '7a8ac112-44d1-45e1-9822-2f45f9eb6c46', 'f68e8a30-1cee-49d6-8132-d080cb8e3fa7', 'cf0cf9e3-6d59-4929-9681-c6b10be4e5d0'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:48 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Flow 'volume_create_manager' (70894caa-7a73-45eb-b014-12434d4ef48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5423e9d-e585-4f04-9204-0d1e1b900eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5423e9d-e585-4f04-9204-0d1e1b900eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1235276472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=676ac69a-7b18-49b7-a637-e8d97298979c,host='devstack@QuobyteHD#QuobyteHD',id=90865f83-b74f-4a71-b7d0-23fc942bd401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228a219f23cb47fcb867d7669b43dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:48Z,use_quota=True,user_id='d5b6829479234c70bb503f8b67b2f969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88554ba9-1114-436d-b0f0-8e3cf5c5604b),volume_type_id=88554ba9-1114-436d-b0f0-8e3cf5c5604b)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7dc764-4858-4404-b1e3-aa9cc4100194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7dc764-4858-4404-b1e3-aa9cc4100194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feb32e3-545b-4f70-8976-68866d0dacc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2feb32e3-545b-4f70-8976-68866d0dacc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90865f83-b74f-4a71-b7d0-23fc942bd401', 'volume_name': 'volume-90865f83-b74f-4a71-b7d0-23fc942bd401', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6565ba0-a119-4160-b7d9-0e8b23c67622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6565ba0-a119-4160-b7d9-0e8b23c67622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c8e1ad-4c23-4fe8-a35b-8a1cbe101449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:48 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Volume 90865f83-b74f-4a71-b7d0-23fc942bd401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90865f83-b74f-4a71-b7d0-23fc942bd401', 'volume_size': 1} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=676ac69a-7b18-49b7-a637-e8d97298979c,created_at=2025-09-15T23:41:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1235276472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=676ac69a-7b18-49b7-a637-e8d97298979c,host='devstack@QuobyteHD#QuobyteHD',id=90865f83-b74f-4a71-b7d0-23fc942bd401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='228a219f23cb47fcb867d7669b43dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:48Z,use_quota=True,user_id='d5b6829479234c70bb503f8b67b2f969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88554ba9-1114-436d-b0f0-8e3cf5c5604b),volume_type_id=88554ba9-1114-436d-b0f0-8e3cf5c5604b)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Creating volume 90865f83-b74f-4a71-b7d0-23fc942bd401 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:41:48 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:41:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.416s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:49 devstack quobyte-client[83066]: System call of process 91954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:41:49 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=59, name=volume-90865f83-b74f-4a71-b7d0-23fc942bd401, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:49 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Deleted volume successfully. Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-983b56cf-564a-4c30-8262-fcc70203b8aa tempest-VolumesTransfersV355Test-153005389 None] Lock "cinder-c1fc3947-149e-4fa6-81f0-3d93070d3dac-delete_volume" released by "delete_volume" :: held 2.162s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 1073741824" returned: 0 in 0.422s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401" returned: 0 in 0.215s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] <== create_volume: return (745ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c8e1ad-4c23-4fe8-a35b-8a1cbe101449) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90865f83-b74f-4a71-b7d0-23fc942bd401', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4b62af-d095-459a-bc6f-ca6b666723d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:49 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Volume volume-90865f83-b74f-4a71-b7d0-23fc942bd401 (90865f83-b74f-4a71-b7d0-23fc942bd401): created successfully Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb4b62af-d095-459a-bc6f-ca6b666723d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:49 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Flow 'volume_create_manager' (70894caa-7a73-45eb-b014-12434d4ef48e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0a036652-e588-4443-9c88-76002cb024ae tempest-GroupSnapshotsV319Test-2141121015 None] Created volume successfully. Sep 16 01:41:50 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Flow 'volume_create_manager' (fb247e36-53a4-4146-b7a1-1ba92a57f7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050bb8c7-77d7-4213-8f48-5581c68540a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (050bb8c7-77d7-4213-8f48-5581c68540a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1436434449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df63752-efcf-41f6-94ff-c0a7f89b2adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdad1cf32854d4c8740e9ad3d1c217f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:50Z,use_quota=True,user_id='4808fe572bec4649ae9f87a651ca9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb3444e-bfdf-42d8-98d2-d8eb0b48c0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcb3444e-bfdf-42d8-98d2-d8eb0b48c0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b92688-9630-46a0-af9b-8ea78f53ed06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77b92688-9630-46a0-af9b-8ea78f53ed06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4df63752-efcf-41f6-94ff-c0a7f89b2adb', 'volume_name': 'volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1473c4a-fbce-4b7a-9cb4-8a64fb297eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1473c4a-fbce-4b7a-9cb4-8a64fb297eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37359586-2932-4f5c-8b75-733060b46258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:50 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Volume 4df63752-efcf-41f6-94ff-c0a7f89b2adb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb', 'volume_size': 1} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:41:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1436434449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4df63752-efcf-41f6-94ff-c0a7f89b2adb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cdad1cf32854d4c8740e9ad3d1c217f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:41:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:41:50Z,use_quota=True,user_id='4808fe572bec4649ae9f87a651ca9b9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Creating volume 4df63752-efcf-41f6-94ff-c0a7f89b2adb {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:41:50 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:50 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=60, name=volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb 1073741824" returned: 0 in 0.496s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb" returned: 0 in 0.156s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] <== create_volume: return (762ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:51 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] GroupSnapshot 872f526f-397a-41ea-b2e9-1c51857ce321: creating. Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37359586-2932-4f5c-8b75-733060b46258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9de52c-ed87-4fe5-85db-6134fc0e6aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:41:51 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Group snapshot 872f526f-397a-41ea-b2e9-1c51857ce321: creating. {{(pid=83041) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}} Sep 16 01:41:51 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Volume volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb (4df63752-efcf-41f6-94ff-c0a7f89b2adb): created successfully Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f9de52c-ed87-4fe5-85db-6134fc0e6aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Flow 'volume_create_manager' (fb247e36-53a4-4146-b7a1-1ba92a57f7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Creating offline snapshot 8e1b01ce-281f-4ff9-8286-9b1c5d0061fc of volume 90865f83-b74f-4a71-b7d0-23fc942bd401 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:41:51 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1041d783-d80e-4246-a5c7-6cd46badadb7 tempest-VolumesTransfersV355Test-1457732776 None] Created volume successfully. Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cd94bb-e354-4a6d-97da-9a399fd9fbb7]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:52 devstack quobyte-client[83066]: System call of process 91963 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401" returned: 0 in 1.018s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:53 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=61, name=volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:41:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Acquiring lock "cinder-4df63752-efcf-41f6-94ff-c0a7f89b2adb-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc 1G" returned: 0 in 0.687s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): qemu-img rebase -u -b volume-90865f83-b74f-4a71-b7d0-23fc942bd401 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Lock "cinder-4df63752-efcf-41f6-94ff-c0a7f89b2adb-delete_volume" acquired by "delete_volume" :: waited 0.345s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:53 devstack quobyte-client[83066]: System call of process 91977 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:41:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "qemu-img rebase -u -b volume-90865f83-b74f-4a71-b7d0-23fc942bd401 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" returned: 0 in 0.505s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:41:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:54 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Acquiring lock "cinder-quobyte-4df63752-efcf-41f6-94ff-c0a7f89b2adb" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" returned: 0 in 0.693s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:41:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Lock "cinder-quobyte-4df63752-efcf-41f6-94ff-c0a7f89b2adb" acquired by "delete_volume" :: waited 0.386s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" returned: 0 in 0.377s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac601570-03e8-43b2-95b4-bd9d5553fd42]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.info" returned: 0 in 0.223s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.info" returned: 0 in 0.160s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.017s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb" returned: 0 in 0.640s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4df63752-efcf-41f6-94ff-c0a7f89b2adb" returned: 0 in 0.120s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Lock "cinder-quobyte-4df63752-efcf-41f6-94ff-c0a7f89b2adb" released by "delete_volume" :: held 1.218s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:56 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e37af464-e27e-4cb7-ad8e-8918066fe193 tempest-GroupSnapshotsV319Test-2141121015 None] group_snapshot 872f526f-397a-41ea-b2e9-1c51857ce321: created successfully Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Created reservations ['faa2f80f-be69-4b1b-9180-19c46fb043af', 'f4459a84-c8e8-40ff-8cd6-d8eb9eb1eef3', '66d63a75-5cfa-424e-880f-a56a36c20754', '0858fd12-c380-44a2-a8b3-4fa53edb16c3'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.115s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:56 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:41:57 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Deleted volume successfully. Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5f7dfdb9-ec1a-411d-9c16-54b97ba7d25d tempest-VolumesTransfersV355Test-153005389 None] Lock "cinder-4df63752-efcf-41f6-94ff-c0a7f89b2adb-delete_volume" released by "delete_volume" :: held 3.437s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:57 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] group_snapshot 872f526f-397a-41ea-b2e9-1c51857ce321: deleting Sep 16 01:41:57 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] group_snapshot 872f526f-397a-41ea-b2e9-1c51857ce321: deleting {{(pid=83041) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}} Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Acquiring lock "cinder-quobyte-90865f83-b74f-4a71-b7d0-23fc942bd401" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "cinder-quobyte-90865f83-b74f-4a71-b7d0-23fc942bd401" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Acquiring lock "cinder-quobyte-8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "cinder-quobyte-8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Deleting offline snapshot 8e1b01ce-281f-4ff9-8286-9b1c5d0061fc of volume 90865f83-b74f-4a71-b7d0-23fc942bd401 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] snapshot_file for this snap is: volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f9e526-a575-4d59-9882-16b4efc76cb7]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" returned: 0 in 0.497s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90865f83-b74f-4a71-b7d0-23fc942bd401(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:41:58 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b2b624-bad5-450c-aefa-c2e4da976fc6]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:41:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401" returned: 0 in 0.496s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" returned: 0 in 0.206s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:41:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401.8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" returned: 0 in 0.132s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:41:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "cinder-quobyte-8e1b01ce-281f-4ff9-8286-9b1c5d0061fc" released by "_delete_snapshot" :: held 1.665s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:41:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "cinder-quobyte-90865f83-b74f-4a71-b7d0-23fc942bd401" released by "delete_snapshot" :: held 1.686s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:00 devstack cinder-volume[83041]: WARNING cinder.quota [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-551771479 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-551771479, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:42:00 devstack cinder-volume[83041]: WARNING cinder.quota [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-551771479 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-551771479, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:42:00 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] Created reservations ['bd9ee91b-a56e-4b50-b2e0-c24767c3ea23', '8ffc864a-7321-4c17-b073-a78b235327b0', '885750a4-876d-4a30-812a-74a84ef11ff0', '5af9b58f-da02-4d46-8cd0-b03ee14288be'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:42:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d890f9aa-1fe5-43e8-b1cf-32c3317b07e6 tempest-GroupSnapshotsV319Test-2141121015 None] group_snapshot 872f526f-397a-41ea-b2e9-1c51857ce321: deleted successfully Sep 16 01:42:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Acquiring lock "cinder-quobyte-90865f83-b74f-4a71-b7d0-23fc942bd401" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "cinder-quobyte-90865f83-b74f-4a71-b7d0-23fc942bd401" acquired by "delete_volume" :: waited 0.028s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:01 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a19561f-a1da-462b-a602-12fedb0d47b0]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:42:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401" returned: 0 in 0.600s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-90865f83-b74f-4a71-b7d0-23fc942bd401" returned: 0 in 0.185s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "cinder-quobyte-90865f83-b74f-4a71-b7d0-23fc942bd401" released by "delete_volume" :: held 1.337s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:03 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Created reservations ['00b4cc06-8037-46a4-a562-bcbe5223c4fb'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:42:04 devstack cinder-volume[83041]: WARNING cinder.quota [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-551771479 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-551771479, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:42:04 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Created reservations ['00cc64ee-31de-40fe-83b7-552f79644f9e', '7cbbf1c0-41bd-4526-8592-e962b9d60367', '817e35ca-d714-4433-b6da-4ef02ccf8489', '699859bc-dd31-4b56-9d3c-9a8dedc5b365'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:42:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:42:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.660s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:42:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.337s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:06 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:42:06 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-a28b37b5-bc85-42bd-a4ad-fde7f3419487 tempest-GroupSnapshotsV319Test-2141121015 None] Delete group completed successfully. Sep 16 01:42:13 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:13 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Flow 'volume_create_manager' (709ca42f-064c-47e8-bcf8-a87278bab250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4c4087-2eb6-4c6c-b5c2-552f49662422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4c4087-2eb6-4c6c-b5c2-552f49662422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1538091230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=797316d8-12d1-43fe-8fcc-4ad4333e30aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='80fffd5e040b42af9bb018ac589c1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:13Z,use_quota=True,user_id='5c1e2cf5464c4b0b993420a234b57a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72ddcf7-b057-4148-a4e6-40b18f0cbf33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d72ddcf7-b057-4148-a4e6-40b18f0cbf33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc48481b-1b18-44bd-be14-55cbd6053131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc48481b-1b18-44bd-be14-55cbd6053131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '797316d8-12d1-43fe-8fcc-4ad4333e30aa', 'volume_name': 'volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70439500-c311-4370-be06-7d37caa9eeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70439500-c311-4370-be06-7d37caa9eeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2d853d-90d1-41e5-a970-a9f5d890833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:14 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Volume 797316d8-12d1-43fe-8fcc-4ad4333e30aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa', 'volume_size': 1} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1538091230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=797316d8-12d1-43fe-8fcc-4ad4333e30aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='80fffd5e040b42af9bb018ac589c1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:13Z,use_quota=True,user_id='5c1e2cf5464c4b0b993420a234b57a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Creating volume 797316d8-12d1-43fe-8fcc-4ad4333e30aa {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:42:14 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:42:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:14 devstack quobyte-client[83066]: System call of process 92096 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:42:14 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=63, name=volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:42:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa 1073741824" returned: 0 in 0.522s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa" returned: 0 in 0.234s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] <== create_volume: return (915ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:42:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:15 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=49,cinder:SELECT=43,cinder:INSERT=10,cinder:DELETE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab2d853d-90d1-41e5-a970-a9f5d890833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6711cc-9c3c-422d-b073-8b2e9380b0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:16 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Volume volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa (797316d8-12d1-43fe-8fcc-4ad4333e30aa): created successfully Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf6711cc-9c3c-422d-b073-8b2e9380b0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Flow 'volume_create_manager' (709ca42f-064c-47e8-bcf8-a87278bab250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:16 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Flow 'volume_create_manager' (7baaa423-0590-455b-8015-9ab81116dfa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cbc987-033a-4ea7-9493-f32abbf45eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90cbc987-033a-4ea7-9493-f32abbf45eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1983590815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81eee83a-59ac-4df4-a01a-0d7da5bde493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5982870de52f4664815a4dc002167215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:15Z,use_quota=True,user_id='26b868e669c14d06aa0946f0d7edbffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba73cd0d-44b6-45f3-8112-8f3e8ea02a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba73cd0d-44b6-45f3-8112-8f3e8ea02a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338246e3-522e-4ff9-b2ba-ea7e3cff56db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (338246e3-522e-4ff9-b2ba-ea7e3cff56db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81eee83a-59ac-4df4-a01a-0d7da5bde493', 'volume_name': 'volume-81eee83a-59ac-4df4-a01a-0d7da5bde493', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1306ccb7-7f1a-4a64-9e6d-df177b637c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1306ccb7-7f1a-4a64-9e6d-df177b637c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb18656-ee87-4251-b4a2-523da195f891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:16 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Volume 81eee83a-59ac-4df4-a01a-0d7da5bde493: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81eee83a-59ac-4df4-a01a-0d7da5bde493', 'volume_size': 1} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1983590815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81eee83a-59ac-4df4-a01a-0d7da5bde493,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5982870de52f4664815a4dc002167215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:15Z,use_quota=True,user_id='26b868e669c14d06aa0946f0d7edbffc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Creating volume 81eee83a-59ac-4df4-a01a-0d7da5bde493 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:42:16 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-81eee83a-59ac-4df4-a01a-0d7da5bde493 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:16 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=64, name=volume-81eee83a-59ac-4df4-a01a-0d7da5bde493, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:42:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-802c36ef-c24e-41cd-90ea-42a280d0183e tempest-VolumesListTestJSON-497361198 None] Created volume successfully. Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-81eee83a-59ac-4df4-a01a-0d7da5bde493 1073741824" returned: 0 in 0.606s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-81eee83a-59ac-4df4-a01a-0d7da5bde493 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-81eee83a-59ac-4df4-a01a-0d7da5bde493" returned: 0 in 0.182s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] <== create_volume: return (880ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb18656-ee87-4251-b4a2-523da195f891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81eee83a-59ac-4df4-a01a-0d7da5bde493', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23877513-d5fe-4c5f-92b1-effccac46362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:17 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Volume volume-81eee83a-59ac-4df4-a01a-0d7da5bde493 (81eee83a-59ac-4df4-a01a-0d7da5bde493): created successfully Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23877513-d5fe-4c5f-92b1-effccac46362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Flow 'volume_create_manager' (7baaa423-0590-455b-8015-9ab81116dfa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:17 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Flow 'volume_create_manager' (e9217254-c3ee-4581-9c15-f6d045a23a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51ff3ce-a56a-4c8e-8620-90062421ad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b51ff3ce-a56a-4c8e-8620-90062421ad20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-475130568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2207bb34-e1e5-4050-b341-1595d7320ff3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='80fffd5e040b42af9bb018ac589c1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:17Z,use_quota=True,user_id='5c1e2cf5464c4b0b993420a234b57a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faf8342-84d5-4e26-afa1-62d00d6b8316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8faf8342-84d5-4e26-afa1-62d00d6b8316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402728b0-45f4-41e0-802b-2937683d0c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402728b0-45f4-41e0-802b-2937683d0c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2207bb34-e1e5-4050-b341-1595d7320ff3', 'volume_name': 'volume-2207bb34-e1e5-4050-b341-1595d7320ff3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef071760-a2e9-44da-9047-e28d258c4ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef071760-a2e9-44da-9047-e28d258c4ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957224ec-4d48-4a78-acaa-232c3f759bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:17 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Volume 2207bb34-e1e5-4050-b341-1595d7320ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2207bb34-e1e5-4050-b341-1595d7320ff3', 'volume_size': 1} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-475130568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2207bb34-e1e5-4050-b341-1595d7320ff3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='80fffd5e040b42af9bb018ac589c1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:17Z,use_quota=True,user_id='5c1e2cf5464c4b0b993420a234b57a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Creating volume 2207bb34-e1e5-4050-b341-1595d7320ff3 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:42:17 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:42:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2207bb34-e1e5-4050-b341-1595d7320ff3 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:17 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5706856c-7cda-425d-911d-c0b7bedbab54 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Created volume successfully. Sep 16 01:42:17 devstack quobyte-client[83066]: System call of process 92104 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:42:17 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=65, name=volume-2207bb34-e1e5-4050-b341-1595d7320ff3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2207bb34-e1e5-4050-b341-1595d7320ff3 1073741824" returned: 0 in 0.370s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2207bb34-e1e5-4050-b341-1595d7320ff3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2207bb34-e1e5-4050-b341-1595d7320ff3" returned: 0 in 0.118s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] <== create_volume: return (533ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.544s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (957224ec-4d48-4a78-acaa-232c3f759bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2207bb34-e1e5-4050-b341-1595d7320ff3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80db66da-c75c-4d1f-9ec4-62aba5c61566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:18 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Volume volume-2207bb34-e1e5-4050-b341-1595d7320ff3 (2207bb34-e1e5-4050-b341-1595d7320ff3): created successfully Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80db66da-c75c-4d1f-9ec4-62aba5c61566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Flow 'volume_create_manager' (e9217254-c3ee-4581-9c15-f6d045a23a97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:18 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d1a346e0-d0a0-4712-8c42-4a5e79b91711 tempest-VolumesListTestJSON-497361198 None] Created volume successfully. Sep 16 01:42:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Acquiring lock "cinder-81eee83a-59ac-4df4-a01a-0d7da5bde493-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "cinder-81eee83a-59ac-4df4-a01a-0d7da5bde493-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:20 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Acquiring lock "cinder-quobyte-81eee83a-59ac-4df4-a01a-0d7da5bde493" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "cinder-quobyte-81eee83a-59ac-4df4-a01a-0d7da5bde493" acquired by "delete_volume" :: waited 0.033s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:20 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Flow 'volume_create_manager' (3da9356c-e5a2-413f-bd79-884b23a0203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cfd032-827f-4e1c-aed2-b750486431a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa29e6d-ba93-4c08-8f28-b5154d4d4521]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6cfd032-827f-4e1c-aed2-b750486431a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1282863877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4e3c75-6a8d-472e-80e5-a49897c0a2fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='80fffd5e040b42af9bb018ac589c1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:20Z,use_quota=True,user_id='5c1e2cf5464c4b0b993420a234b57a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27d36f5-088b-4253-83e2-a3796af47d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27d36f5-088b-4253-83e2-a3796af47d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6bf91f-7f8e-49bc-8e1e-17069357c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6bf91f-7f8e-49bc-8e1e-17069357c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4e3c75-6a8d-472e-80e5-a49897c0a2fa', 'volume_name': 'volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa15a829-2c80-447c-b205-ef7ae5729cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa15a829-2c80-447c-b205-ef7ae5729cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858ac285-ff5c-4552-8ac3-771b33e366e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:20 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Volume ba4e3c75-6a8d-472e-80e5-a49897c0a2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa', 'volume_size': 1} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1282863877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4e3c75-6a8d-472e-80e5-a49897c0a2fa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='80fffd5e040b42af9bb018ac589c1c68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:20Z,use_quota=True,user_id='5c1e2cf5464c4b0b993420a234b57a8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Creating volume ba4e3c75-6a8d-472e-80e5-a49897c0a2fa {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:42:20 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-81eee83a-59ac-4df4-a01a-0d7da5bde493 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:20 devstack quobyte-client[83066]: System call of process 92108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:42:20 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=66, name=volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:42:20 devstack quobyte-client[83066]: System call of process 92109 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:42:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-81eee83a-59ac-4df4-a01a-0d7da5bde493" returned: 0 in 0.566s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-81eee83a-59ac-4df4-a01a-0d7da5bde493 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa 1073741824" returned: 0 in 0.905s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-81eee83a-59ac-4df4-a01a-0d7da5bde493" returned: 0 in 0.362s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "cinder-quobyte-81eee83a-59ac-4df4-a01a-0d7da5bde493" released by "delete_volume" :: held 1.324s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa" returned: 0 in 0.384s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] <== create_volume: return (1328ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.337s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (858ac285-ff5c-4552-8ac3-771b33e366e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a01af6-4fe7-46a3-a548-7384bd5cfbca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:21 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Volume volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa (ba4e3c75-6a8d-472e-80e5-a49897c0a2fa): created successfully Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a01af6-4fe7-46a3-a548-7384bd5cfbca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Flow 'volume_create_manager' (3da9356c-e5a2-413f-bd79-884b23a0203c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:21 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-687cca63-79c1-4efe-83e0-161e871f4752 tempest-VolumesListTestJSON-497361198 None] Created volume successfully. Sep 16 01:42:21 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Created reservations ['b6295636-11cd-4a00-8ba3-41f3b5be80bf', '3d1e8572-b027-4b5f-a0d6-b8089def505a', '7e92d511-b592-4f96-8728-b616e4605b91', '88128bcf-7cf2-4349-941f-9a07d3a8a97e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:42:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.124s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:22 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:42:22 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Deleted volume successfully. Sep 16 01:42:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cd0910ce-d982-496f-8604-2fdb632f2956 tempest-VolumeQuotasNegativeTestJSON-1230503630 None] Lock "cinder-81eee83a-59ac-4df4-a01a-0d7da5bde493-delete_volume" released by "delete_volume" :: held 3.737s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "cinder-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Lock "cinder-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:28 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "cinder-quobyte-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Lock "cinder-quobyte-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa" acquired by "delete_volume" :: waited 0.026s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:29 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[38809f18-5eec-42b0-a673-e9205c580905]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:42:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:29 devstack quobyte-client[83066]: System call of process 92157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:42:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa" returned: 0 in 0.583s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa" returned: 0 in 0.149s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Lock "cinder-quobyte-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa" released by "delete_volume" :: held 0.977s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Created reservations ['4fb0024e-b7df-4bb0-bf40-1368784acd5e', '63eeafbe-c66c-436a-b641-3e0db5118e0d', '79d0694e-4960-41fb-b30c-263a56bdc738', '851736e5-fa59-4b72-95d7-07a11736d0c9'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.121s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:30 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:42:30 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Deleted volume successfully. Sep 16 01:42:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ffe9cc24-4c7d-46a8-91b0-134d25619263 tempest-VolumesListTestJSON-497361198 None] Lock "cinder-ba4e3c75-6a8d-472e-80e5-a49897c0a2fa-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "cinder-2207bb34-e1e5-4050-b341-1595d7320ff3-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Lock "cinder-2207bb34-e1e5-4050-b341-1595d7320ff3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:32 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "cinder-quobyte-2207bb34-e1e5-4050-b341-1595d7320ff3" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Lock "cinder-quobyte-2207bb34-e1e5-4050-b341-1595d7320ff3" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:32 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[07865b10-1cb9-49c1-b02a-171f06442c9c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:42:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2207bb34-e1e5-4050-b341-1595d7320ff3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2207bb34-e1e5-4050-b341-1595d7320ff3" returned: 0 in 1.064s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2207bb34-e1e5-4050-b341-1595d7320ff3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2207bb34-e1e5-4050-b341-1595d7320ff3" returned: 0 in 0.261s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Lock "cinder-quobyte-2207bb34-e1e5-4050-b341-1595d7320ff3" released by "delete_volume" :: held 1.588s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:34 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Created reservations ['61da6189-9564-4206-bd9f-bf55a57c2cbd', 'fd90772a-5502-4c9d-a7c2-16eed849060d', '88e37dd7-3d00-45f6-bc4b-f30a3b4b5a82', 'c4a39fac-13c2-4dc2-aa61-c090fe145738'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:42:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.244s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:35 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:42:35 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Deleted volume successfully. Sep 16 01:42:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97c75187-85d1-4aef-8b99-f581970ef101 tempest-VolumesListTestJSON-497361198 None] Lock "cinder-2207bb34-e1e5-4050-b341-1595d7320ff3-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Acquiring lock "cinder-797316d8-12d1-43fe-8fcc-4ad4333e30aa-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Lock "cinder-797316d8-12d1-43fe-8fcc-4ad4333e30aa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:35 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Acquiring lock "cinder-quobyte-797316d8-12d1-43fe-8fcc-4ad4333e30aa" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Lock "cinder-quobyte-797316d8-12d1-43fe-8fcc-4ad4333e30aa" acquired by "delete_volume" :: waited 0.009s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea735ed6-bf89-4f6d-8cad-6d35ac5cbd1f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:42:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:36 devstack quobyte-client[83066]: System call of process 92178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:42:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa" returned: 0 in 0.594s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-797316d8-12d1-43fe-8fcc-4ad4333e30aa" returned: 0 in 0.190s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Lock "cinder-quobyte-797316d8-12d1-43fe-8fcc-4ad4333e30aa" released by "delete_volume" :: held 1.073s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Created reservations ['4298a1d2-8c48-4cf3-9c08-56eae5083e4e', '18a9f596-8acd-4cd6-ba79-53cc042f7601', '05218063-3b46-46af-a5a8-1703b76bd8b9', '8e1fcaa0-a48e-4219-b4ca-c4655fd8df3a'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.127s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:37 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:42:37 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Deleted volume successfully. Sep 16 01:42:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-753c78df-f4f9-4cb9-8055-97378757786a tempest-VolumesListTestJSON-497361198 None] Lock "cinder-797316d8-12d1-43fe-8fcc-4ad4333e30aa-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:41 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:42:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Flow 'volume_create_manager' (3fdb363e-96c1-4c93-8d55-18c49bf33f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e849a4-c34a-42e3-b636-b0bbc78ca6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:INSERT=22,cinder:SELECT=69,cinder:UPDATE=92,cinder:DELETE=6 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e849a4-c34a-42e3-b636-b0bbc78ca6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-123639047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6844e0a1-1bad-41dd-b8ee-266ae81adc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcd7a83bd9148cd84742211234a5097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:42Z,use_quota=True,user_id='ec7a47946d6f41a6acffeeffa7df7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76b39492-399d-4589-951b-020eecfa5c99),volume_type_id=76b39492-399d-4589-951b-020eecfa5c99)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3603b1b7-3bac-422f-9ebb-2dc525bc049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3603b1b7-3bac-422f-9ebb-2dc525bc049e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8851c91d-467b-4048-a686-2a47e67b1d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8851c91d-467b-4048-a686-2a47e67b1d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6844e0a1-1bad-41dd-b8ee-266ae81adc4b', 'volume_name': 'volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e3bb60-41cd-4d07-bf6f-fd1d43a704a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e3bb60-41cd-4d07-bf6f-fd1d43a704a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a2e90d-405a-45be-8031-77bd4daa4919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:42 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Volume 6844e0a1-1bad-41dd-b8ee-266ae81adc4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b', 'volume_size': 1} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:42:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-123639047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6844e0a1-1bad-41dd-b8ee-266ae81adc4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bcd7a83bd9148cd84742211234a5097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:42:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:42:42Z,use_quota=True,user_id='ec7a47946d6f41a6acffeeffa7df7161',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76b39492-399d-4589-951b-020eecfa5c99),volume_type_id=76b39492-399d-4589-951b-020eecfa5c99)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Creating volume 6844e0a1-1bad-41dd-b8ee-266ae81adc4b {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:42:42 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:42 devstack quobyte-client[83066]: System call of process 92201 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:42:42 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=67, name=volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b 1073741824" returned: 0 in 0.459s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b" returned: 0 in 0.227s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] <== create_volume: return (795ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:42:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a2e90d-405a-45be-8031-77bd4daa4919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67218236-baf6-4c62-8e1d-ade10b8f31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:42:43 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Volume volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b (6844e0a1-1bad-41dd-b8ee-266ae81adc4b): created successfully Sep 16 01:42:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67218236-baf6-4c62-8e1d-ade10b8f31b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:42:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Flow 'volume_create_manager' (3fdb363e-96c1-4c93-8d55-18c49bf33f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:42:43 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1c12c216-013b-4041-b065-be090e4dd18c tempest-VolumeTypesAccessTest-301651347 None] Created volume successfully. Sep 16 01:42:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Acquiring lock "cinder-6844e0a1-1bad-41dd-b8ee-266ae81adc4b-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Lock "cinder-6844e0a1-1bad-41dd-b8ee-266ae81adc4b-delete_volume" acquired by "delete_volume" :: waited 0.130s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:42:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Acquiring lock "cinder-quobyte-6844e0a1-1bad-41dd-b8ee-266ae81adc4b" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:42:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Lock "cinder-quobyte-6844e0a1-1bad-41dd-b8ee-266ae81adc4b" acquired by "delete_volume" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:42:44 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2743ab9-9af1-461d-ae4d-78ee26969acd]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:42:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b" returned: 0 in 0.818s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6844e0a1-1bad-41dd-b8ee-266ae81adc4b" returned: 0 in 0.173s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Lock "cinder-quobyte-6844e0a1-1bad-41dd-b8ee-266ae81adc4b" released by "delete_volume" :: held 1.292s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:46 devstack cinder-volume[83041]: WARNING cinder.quota [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-850989456 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-850989456, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:42:46 devstack cinder-volume[83041]: WARNING cinder.quota [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-850989456 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-850989456, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Created reservations ['9fc70854-fa2c-4c04-813d-845df8528e58', '83fa8f8e-3477-4f77-a0bb-ceccb0e8ea09', '939b3499-5430-42ba-8775-1990727e315c', '02643797-aba9-486e-b7a6-5225741ceaee'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.189s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:42:46 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:42:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Deleted volume successfully. Sep 16 01:42:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d58ec2d2-f874-4165-ace1-a8174461300d tempest-VolumeTypesAccessTest-301651347 None] Lock "cinder-6844e0a1-1bad-41dd-b8ee-266ae81adc4b-delete_volume" released by "delete_volume" :: held 2.987s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:42:56 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=7,cinder:DELETE=1,cinder:SELECT=6,cinder:INSERT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:42:57 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=56,cinder:SELECT=30,cinder:DELETE=5,cinder:INSERT=9 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.133s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:43:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:06 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:43:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Flow 'volume_create_manager' (860b1a1f-a33f-40a6-a854-9fa089749f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875e8870-bbd0-4d11-803a-9cde292e0d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875e8870-bbd0-4d11-803a-9cde292e0d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2046074428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cd9237-29ca-4e45-a9fd-3e890679a1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c8bd2596144e29bc8af65079b8e2b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:06Z,use_quota=True,user_id='8e6c1aeb5723493599799e9af1a21342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b6d4eb-731b-4e51-8cdc-d655cb1c9bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b6d4eb-731b-4e51-8cdc-d655cb1c9bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cbb59a-2c77-4300-b9e7-8508b32ec962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:06 devstack cinder-volume[83041]: DEBUG cinder.image.glance [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Creating Keystone auth plugin from conf {{(pid=83041) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 01:43:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1cbb59a-2c77-4300-b9e7-8508b32ec962) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b9cd9237-29ca-4e45-a9fd-3e890679a1ba', 'volume_name': 'volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9749918e-f7cf-4a89-8bda-e20b2734f0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9749918e-f7cf-4a89-8bda-e20b2734f0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614eb5a0-6332-4f9f-9a00-2dce01b7c99d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:07 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Volume b9cd9237-29ca-4e45-a9fd-3e890679a1ba: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 01:43:07 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Cloning b9cd9237-29ca-4e45-a9fd-3e890679a1ba from image 4fb31587-8398-4719-bd55-69963b8198da at location (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]). {{(pid=83041) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 01:43:08 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 01:43:08 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Image download 20.69 MB at 20.69 MB/s Sep 16 01:43:08 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[06352e4a-9b82-45c7-b73d-02d7c8b28deb]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:08 devstack sudo[92234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD Sep 16 01:43:08 devstack sudo[92234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:43:11 devstack sudo[92234]: pam_unix(sudo:session): session closed for user root Sep 16 01:43:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD" returned: 0 in 2.940s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:11 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Temporary image 4fb31587-8398-4719-bd55-69963b8198da is fetched for user 8e6c1aeb5723493599799e9af1a21342. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 01:43:11 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0937ea2-afde-423c-b382-d6c0d9de554b]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:12 devstack sudo[92239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD Sep 16 01:43:12 devstack sudo[92239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:43:14 devstack sudo[92239]: pam_unix(sudo:session): session closed for user root Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD" returned: 0 in 2.499s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2046074428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cd9237-29ca-4e45-a9fd-3e890679a1ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33c8bd2596144e29bc8af65079b8e2b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:06Z,use_quota=True,user_id='8e6c1aeb5723493599799e9af1a21342',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Creating volume b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:43:14 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:14 devstack quobyte-client[83066]: System call of process 92245 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:14 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=68, name=volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba 1073741824" returned: 0 in 0.423s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" returned: 0 in 0.120s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] <== create_volume: return (660ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:43:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:15 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Attempting download of 4fb31587-8398-4719-bd55-69963b8198da ((None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}])) to volume b9cd9237-29ca-4e45-a9fd-3e890679a1ba. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 01:43:15 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be4410-04ef-412b-8f12-f123ac0f9fed]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_x6r8fya2 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:16 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Flow 'volume_create_manager' (b953a26f-0aba-4fe5-b7b6-bbc279991844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6146629-c9c5-489b-969f-de07a8e4d96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6146629-c9c5-489b-969f-de07a8e4d96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-197499078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d014018-2841-432d-8a71-3a946f10ef01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f916047da9d144ce862622c0a3e68aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:16Z,use_quota=True,user_id='15e6edabcc8b4b7ba800a878d5b2e40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22c0923b-cafe-48ed-aac3-49d1515eb011),volume_type_id=22c0923b-cafe-48ed-aac3-49d1515eb011)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5198c31f-e54f-472c-b9ce-2b328d0721ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5198c31f-e54f-472c-b9ce-2b328d0721ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a40fbbb-e274-4904-a01c-73f597f761c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a40fbbb-e274-4904-a01c-73f597f761c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d014018-2841-432d-8a71-3a946f10ef01', 'volume_name': 'volume-3d014018-2841-432d-8a71-3a946f10ef01', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fed8ff1-f9a2-4b44-8a7e-541231cc193e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fed8ff1-f9a2-4b44-8a7e-541231cc193e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbaf217-8eef-400d-9ab9-144c72d6aeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:16 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume 3d014018-2841-432d-8a71-3a946f10ef01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d014018-2841-432d-8a71-3a946f10ef01', 'volume_size': 1} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-197499078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d014018-2841-432d-8a71-3a946f10ef01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f916047da9d144ce862622c0a3e68aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:16Z,use_quota=True,user_id='15e6edabcc8b4b7ba800a878d5b2e40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22c0923b-cafe-48ed-aac3-49d1515eb011),volume_type_id=22c0923b-cafe-48ed-aac3-49d1515eb011)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Creating volume 3d014018-2841-432d-8a71-3a946f10ef01 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:43:16 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:43:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3d014018-2841-432d-8a71-3a946f10ef01 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:17 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=69, name=volume-3d014018-2841-432d-8a71-3a946f10ef01, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:17 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Flow 'volume_create_manager' (868bed22-1796-40c9-beae-7d7d4f58ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a30600-fa85-4fef-9d3a-06584312519f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_x6r8fya2" returned: 0 in 2.053s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97a30600-fa85-4fef-9d3a-06584312519f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-510856044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b43f9c-234f-4c05-a851-69cb35b8354e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f916047da9d144ce862622c0a3e68aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:16Z,use_quota=True,user_id='15e6edabcc8b4b7ba800a878d5b2e40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(486a466f-719b-4d27-a1e1-7e62809fb260),volume_type_id=486a466f-719b-4d27-a1e1-7e62809fb260)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde617f6-8008-47fa-9dfe-5e9ef618fe47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde617f6-8008-47fa-9dfe-5e9ef618fe47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0c6e99-a244-4e25-bef2-affdc01400ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd0c6e99-a244-4e25-bef2-affdc01400ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85b43f9c-234f-4c05-a851-69cb35b8354e', 'volume_name': 'volume-85b43f9c-234f-4c05-a851-69cb35b8354e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d2f5af-d530-4e9a-96a4-243a19258ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11d2f5af-d530-4e9a-96a4-243a19258ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdf9928-0195-4307-b81a-f4ccf407b098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:17 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume 85b43f9c-234f-4c05-a851-69cb35b8354e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85b43f9c-234f-4c05-a851-69cb35b8354e', 'volume_size': 1} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_x6r8fya2 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:18 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Flow 'volume_create_manager' (27be1731-f3c1-4fb7-90d6-3427f9347046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69e295f-22bf-4a59-bd45-1a1c10dc1090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e69e295f-22bf-4a59-bd45-1a1c10dc1090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2104058217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f916047da9d144ce862622c0a3e68aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:17Z,use_quota=True,user_id='15e6edabcc8b4b7ba800a878d5b2e40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b93fc375-e4d5-4828-bc7e-599761c41457),volume_type_id=b93fc375-e4d5-4828-bc7e-599761c41457)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01dd77a-f9de-4b11-bf35-e50b11450c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01dd77a-f9de-4b11-bf35-e50b11450c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de2c358-ce76-49d4-bf70-5d5a92eb6deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG cinder.image.glance [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Creating Keystone auth plugin from conf {{(pid=83041) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3d014018-2841-432d-8a71-3a946f10ef01 1073741824" returned: 0 in 1.862s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3d014018-2841-432d-8a71-3a946f10ef01 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:19 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Flow 'volume_create_manager' (f80ace3b-12b6-455b-a6e0-7f70c2fbb4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cc010d-431f-4747-8ae3-a81744cc429a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65cc010d-431f-4747-8ae3-a81744cc429a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1700894072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a62d62-bcd4-492e-ac58-422d64a7073a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23d266accd84b42b2caf540c11f8e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:18Z,use_quota=True,user_id='6345a7280ae64336869ff0e1c8a79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3ddcfa-545f-49f3-a21f-6121bb48bbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a3ddcfa-545f-49f3-a21f-6121bb48bbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6391232f-af1c-40ce-a04f-a11e09f01d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6391232f-af1c-40ce-a04f-a11e09f01d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a62d62-bcd4-492e-ac58-422d64a7073a', 'volume_name': 'volume-46a62d62-bcd4-492e-ac58-422d64a7073a', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6d159d-f0a6-4b73-abe8-3e8425bcecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6d159d-f0a6-4b73-abe8-3e8425bcecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac38f18f-a192-45be-abc1-d863e5708420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:19 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Volume 46a62d62-bcd4-492e-ac58-422d64a7073a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a62d62-bcd4-492e-ac58-422d64a7073a', 'volume_size': 1} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_x6r8fya2" returned: 1 in 1.599s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_x6r8fya2' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3d014018-2841-432d-8a71-3a946f10ef01" returned: 0 in 0.700s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa52907a-9988-493a-86e3-e709dd424b56]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] <== create_volume: return (2626ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.635s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-510856044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85b43f9c-234f-4c05-a851-69cb35b8354e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f916047da9d144ce862622c0a3e68aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:16Z,use_quota=True,user_id='15e6edabcc8b4b7ba800a878d5b2e40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(486a466f-719b-4d27-a1e1-7e62809fb260),volume_type_id=486a466f-719b-4d27-a1e1-7e62809fb260)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Creating volume 85b43f9c-234f-4c05-a851-69cb35b8354e {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:43:19 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:43:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85b43f9c-234f-4c05-a851-69cb35b8354e 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:19 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=70, name=volume-85b43f9c-234f-4c05-a851-69cb35b8354e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfbaf217-8eef-400d-9ab9-144c72d6aeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d014018-2841-432d-8a71-3a946f10ef01', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16d8e34-7a8d-438b-a235-26e04e1c98c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:20 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume volume-3d014018-2841-432d-8a71-3a946f10ef01 (3d014018-2841-432d-8a71-3a946f10ef01): created successfully Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c16d8e34-7a8d-438b-a235-26e04e1c98c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Flow 'volume_create_manager' (b953a26f-0aba-4fe5-b7b6-bbc279991844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD" returned: 0 in 0.852s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85b43f9c-234f-4c05-a851-69cb35b8354e 1073741824" returned: 0 in 0.542s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] 4fb31587-8398-4719-bd55-69963b8198da was qcow2, converting to raw {{(pid=83041) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85b43f9c-234f-4c05-a851-69cb35b8354e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:20 devstack quobyte-client[83066]: System call of process 92265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:20 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=68, name=volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de2c358-ce76-49d4-bf70-5d5a92eb6deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0', 'volume_name': 'volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0', 'volume_size': 1, 'image_id': '62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--99959056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f916047da9d144ce862622c0a3e68aa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'created_at': datetime.datetime(2025, 9, 15, 23, 43, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 43, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0/file', 'properties': {}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2c9743-8be3-41d7-b082-6be598f0c269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee2c9743-8be3-41d7-b082-6be598f0c269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fa76fa-1f30-4223-85c6-da8447e28eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:20 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0', 'volume_size': 1, 'image_id': '62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--99959056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f916047da9d144ce862622c0a3e68aa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'created_at': datetime.datetime(2025, 9, 15, 23, 43, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 43, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0/file', 'properties': {}}, 'image_service': } Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Cloning f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 from image 62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'metadata': {}}]). {{(pid=83041) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 01:43:20 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2bbd9fe8-b183-437f-af4c-b775dc0f5ea5 tempest-TestInstancesWithCinderVolumes-1827331666 None] Created volume successfully. Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85b43f9c-234f-4c05-a851-69cb35b8354e" returned: 0 in 0.530s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] <== create_volume: return (1173ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:43:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.576s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1700894072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a62d62-bcd4-492e-ac58-422d64a7073a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23d266accd84b42b2caf540c11f8e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:18Z,use_quota=True,user_id='6345a7280ae64336869ff0e1c8a79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Creating volume 46a62d62-bcd4-492e-ac58-422d64a7073a {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:43:21 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:21 devstack quobyte-client[83066]: System call of process 92272 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:21 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=71, name=volume-46a62d62-bcd4-492e-ac58-422d64a7073a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bdf9928-0195-4307-b81a-f4ccf407b098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85b43f9c-234f-4c05-a851-69cb35b8354e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9148a66-5c20-4d04-a181-327e954a00d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:21 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume volume-85b43f9c-234f-4c05-a851-69cb35b8354e (85b43f9c-234f-4c05-a851-69cb35b8354e): created successfully Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9148a66-5c20-4d04-a181-327e954a00d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Flow 'volume_create_manager' (868bed22-1796-40c9-beae-7d7d4f58ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" returned: 0 in 1.257s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_e4qd7cjrdevstack@QuobyteHD, size 112.00 MB, duration 1.26 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:43:21 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Converted 112.00 MB image at 88.71 MB/s Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:21 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-57675c0e-892d-47fc-907d-4304cd687c29 tempest-TestInstancesWithCinderVolumes-1827331666 None] Created volume successfully. Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a 1073741824" returned: 0 in 0.877s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba 1G" returned: 0 in 0.378s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a" returned: 0 in 0.133s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] <== create_volume: return (1067ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3db78ac-db8b-478b-ab95-4e68c421edad]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac38f18f-a192-45be-abc1-d863e5708420) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a62d62-bcd4-492e-ac58-422d64a7073a', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d45cc9-777c-40c5-b01a-064d68cf9087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:22 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Volume volume-46a62d62-bcd4-492e-ac58-422d64a7073a (46a62d62-bcd4-492e-ac58-422d64a7073a): created successfully Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d45cc9-777c-40c5-b01a-064d68cf9087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Flow 'volume_create_manager' (f80ace3b-12b6-455b-a6e0-7f70c2fbb4f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:22 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-49c790fc-4c09-487c-a69c-2d819309cf50 tempest-AttachVolumeNegativeTest-678661232 None] Created volume successfully. Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" returned: 0 in 0.523s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" returned: 1 in 0.396s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Downloaded image 4fb31587-8398-4719-bd55-69963b8198da ((None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}])) to volume b9cd9237-29ca-4e45-a9fd-3e890679a1ba successfully. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Temporary image 4fb31587-8398-4719-bd55-69963b8198da for user 8e6c1aeb5723493599799e9af1a21342 is deleted. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Marking volume b9cd9237-29ca-4e45-a9fd-3e890679a1ba as bootable. {{(pid=83041) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Copying metadata from image 4fb31587-8398-4719-bd55-69963b8198da to b9cd9237-29ca-4e45-a9fd-3e890679a1ba. {{(pid=83041) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Creating volume glance metadata for volume b9cd9237-29ca-4e45-a9fd-3e890679a1ba backed by image 4fb31587-8398-4719-bd55-69963b8198da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83041) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (614eb5a0-6332-4f9f-9a00-2dce01b7c99d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8df6f9-d0fb-4a6e-a560-e0939dc2042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:23 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Volume volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba (b9cd9237-29ca-4e45-a9fd-3e890679a1ba): created successfully Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c8df6f9-d0fb-4a6e-a560-e0939dc2042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Flow 'volume_create_manager' (860b1a1f-a33f-40a6-a854-9fa089749f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:23 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f40eb56d-8272-403c-bb49-49444a5f468a tempest-VolumesImageMetadata-448687863 None] Created volume successfully. Sep 16 01:43:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Acquiring lock "cinder-b9cd9237-29ca-4e45-a9fd-3e890679a1ba-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:43:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Lock "cinder-b9cd9237-29ca-4e45-a9fd-3e890679a1ba-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:43:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Acquiring lock "cinder-quobyte-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Lock "cinder-quobyte-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aaae6b5-5cce-4393-a640-0a7504dc8e35]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" returned: 0 in 0.399s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD, size 20.69 MB, duration 4.89 sec {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 01:43:25 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Image download 20.69 MB at 4.23 MB/s Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1e607b-5e7c-4d2d-a280-0bbb805eb1cc]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" returned: 1 in 0.577s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" returned: 0 in 0.108s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Lock "cinder-quobyte-b9cd9237-29ca-4e45-a9fd-3e890679a1ba" released by "delete_volume" :: held 1.331s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:43:26 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD Sep 16 01:43:26 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Created reservations ['83718e9e-4cd9-46ee-ac65-0ef2abfde67f', '44bb510e-36ea-46c4-9a9c-96fae18d556d', '05a16317-1665-4186-bbc4-3d86ad98295d', 'e7105a12-ff2a-4d77-9872-b54c64da7ec7'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.116s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:27 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:43:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Deleted volume successfully. Sep 16 01:43:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b8713d3a-41c7-44ac-b6f3-e82454271705 tempest-VolumesImageMetadata-448687863 None] Lock "cinder-b9cd9237-29ca-4e45-a9fd-3e890679a1ba-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:43:29 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-eb2e5848-9f61-4934-a87d-9b09ecffc08f req-750d5abc-5c61-424b-baa8-9a63f84a6b4b tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-eb2e5848-9f61-4934-a87d-9b09ecffc08f req-750d5abc-5c61-424b-baa8-9a63f84a6b4b tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD" returned: 0 in 3.263s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Temporary image 62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0 is fetched for user 15e6edabcc8b4b7ba800a878d5b2e40b. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d72b52f-2809-4d5c-8584-1c30fd2bdfe9]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-eb2e5848-9f61-4934-a87d-9b09ecffc08f req-750d5abc-5c61-424b-baa8-9a63f84a6b4b tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba61e68-19e2-4fc5-9596-a70b8504926f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-eb2e5848-9f61-4934-a87d-9b09ecffc08f req-750d5abc-5c61-424b-baa8-9a63f84a6b4b tempest-AttachVolumeNegativeTest-678661232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a" returned: 0 in 0.666s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-eb2e5848-9f61-4934-a87d-9b09ecffc08f req-750d5abc-5c61-424b-baa8-9a63f84a6b4b tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.765s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-eb2e5848-9f61-4934-a87d-9b09ecffc08f req-750d5abc-5c61-424b-baa8-9a63f84a6b4b tempest-AttachVolumeNegativeTest-678661232 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-46a62d62-bcd4-492e-ac58-422d64a7073a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae602040-7f7f-4de9-b381-5a6ce5b81327', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:43:30 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-eb2e5848-9f61-4934-a87d-9b09ecffc08f req-750d5abc-5c61-424b-baa8-9a63f84a6b4b tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:30 devstack sudo[92345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD Sep 16 01:43:30 devstack sudo[92345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:43:30 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-eb2e5848-9f61-4934-a87d-9b09ecffc08f req-750d5abc-5c61-424b-baa8-9a63f84a6b4b tempest-AttachVolumeNegativeTest-678661232 None] attachment_update completed successfully. Sep 16 01:43:32 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Flow 'volume_create_manager' (4182c71c-7e5c-42d7-bb23-d27b1ad9252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e35362-6040-46d1-ad14-24954c7e2391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e35362-6040-46d1-ad14-24954c7e2391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-279105167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64730a97-87ce-4c5a-bc31-2057c12435d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9e1717176d436a9e326a90c8a8b1a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:32Z,use_quota=True,user_id='f36d4346a67b4deb948e386da249b598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17293235-1202-4b10-86c7-93b071d29b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17293235-1202-4b10-86c7-93b071d29b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5db38cb-b979-4b38-8a2e-d1a465c402d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5db38cb-b979-4b38-8a2e-d1a465c402d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64730a97-87ce-4c5a-bc31-2057c12435d7', 'volume_name': 'volume-64730a97-87ce-4c5a-bc31-2057c12435d7', 'volume_size': 2}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0848ca6b-ea20-4f61-9f6b-aa27a8afeb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0848ca6b-ea20-4f61-9f6b-aa27a8afeb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd4b6e3-b980-4deb-b836-18f1b6081892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:32 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Volume 64730a97-87ce-4c5a-bc31-2057c12435d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64730a97-87ce-4c5a-bc31-2057c12435d7', 'volume_size': 2} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-279105167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64730a97-87ce-4c5a-bc31-2057c12435d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b9e1717176d436a9e326a90c8a8b1a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:32Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:32Z,use_quota=True,user_id='f36d4346a67b4deb948e386da249b598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Creating volume 64730a97-87ce-4c5a-bc31-2057c12435d7 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:43:32 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:43:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-64730a97-87ce-4c5a-bc31-2057c12435d7 2147483648 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:32 devstack quobyte-client[83066]: System call of process 92419 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:32 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=72, name=volume-64730a97-87ce-4c5a-bc31-2057c12435d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:32 devstack sudo[92345]: pam_unix(sudo:session): session closed for user root Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD" returned: 0 in 3.300s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-64730a97-87ce-4c5a-bc31-2057c12435d7 2147483648" returned: 0 in 0.672s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-64730a97-87ce-4c5a-bc31-2057c12435d7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-64730a97-87ce-4c5a-bc31-2057c12435d7" returned: 0 in 0.106s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] <== create_volume: return (847ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.369s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2104058217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f916047da9d144ce862622c0a3e68aa6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:17Z,use_quota=True,user_id='15e6edabcc8b4b7ba800a878d5b2e40b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b93fc375-e4d5-4828-bc7e-599761c41457),volume_type_id=b93fc375-e4d5-4828-bc7e-599761c41457)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Creating volume f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:43:33 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:33 devstack quobyte-client[83066]: System call of process 92741 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:33 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=73, name=volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cd4b6e3-b980-4deb-b836-18f1b6081892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64730a97-87ce-4c5a-bc31-2057c12435d7', 'volume_size': 2}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449f995f-9f06-4a97-9297-d5de5fd4edf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:34 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Volume volume-64730a97-87ce-4c5a-bc31-2057c12435d7 (64730a97-87ce-4c5a-bc31-2057c12435d7): created successfully Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (449f995f-9f06-4a97-9297-d5de5fd4edf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Flow 'volume_create_manager' (4182c71c-7e5c-42d7-bb23-d27b1ad9252c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 1073741824" returned: 0 in 0.648s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 0 in 0.388s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] <== create_volume: return (1096ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:34 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8ba76d35-1e6c-48d7-a525-83689175a837 tempest-VolumesCloneNegativeTest-1037003044 None] Created volume successfully. Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Attempting download of 62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'metadata': {}}])) to volume f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 01:43:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Acquiring lock "cinder-64730a97-87ce-4c5a-bc31-2057c12435d7-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "cinder-64730a97-87ce-4c5a-bc31-2057c12435d7-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[544b47de-9b9e-48c4-be26-785b30ff1a9a]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0_qbonud85 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:35 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Acquiring lock "cinder-quobyte-64730a97-87ce-4c5a-bc31-2057c12435d7" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "cinder-quobyte-64730a97-87ce-4c5a-bc31-2057c12435d7" acquired by "delete_volume" :: waited 0.088s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457ac78-f49d-4370-a6d8-cce06a5cbd29]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-64730a97-87ce-4c5a-bc31-2057c12435d7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0_qbonud85" returned: 0 in 0.745s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0_qbonud85 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0_qbonud85" returned: 1 in 0.618s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0_qbonud85' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-64730a97-87ce-4c5a-bc31-2057c12435d7" returned: 0 in 0.845s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-64730a97-87ce-4c5a-bc31-2057c12435d7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32238eb-b4ef-44be-8a73-f50458eef02d]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-64730a97-87ce-4c5a-bc31-2057c12435d7" returned: 0 in 0.240s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "cinder-quobyte-64730a97-87ce-4c5a-bc31-2057c12435d7" released by "delete_volume" :: held 1.333s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:43:37 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Created reservations ['11c0ef3d-e547-4084-ae07-1bc7075e7203', 'eec16825-0c9e-4d5a-8874-6eecf1ab4ba6', '8914e1ca-1a39-40a8-8c96-fc8191e89eb8', 'b02d1d58-6935-4e5c-ad24-20dbf9e0a3b8'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:43:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:37 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] 62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0 was qcow2, converting to raw {{(pid=83041) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 01:43:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:37 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=73, name=volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.133s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:43:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Deleted volume successfully. Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 0 in 1.403s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:38 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0__37qq3mydevstack@QuobyteHD, size 112.00 MB, duration 1.41 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:43:38 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Converted 112.00 MB image at 79.34 MB/s Sep 16 01:43:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ac11692e-7e68-4f64-99da-d77fbd51bd33 tempest-VolumesCloneNegativeTest-1037003044 None] Lock "cinder-64730a97-87ce-4c5a-bc31-2057c12435d7-delete_volume" released by "delete_volume" :: held 4.185s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:43:39 devstack quobyte-client[83066]: System call of process 92773 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 1G" returned: 0 in 0.284s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:39 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[897189e3-a406-4edf-b378-44252f999fbc]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 0 in 0.543s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 1 in 0.432s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Downloaded image 62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0 ((None, [{'url': 'file:///opt/stack/data/glance/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'metadata': {}}])) to volume f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 successfully. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Temporary image 62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0 for user 15e6edabcc8b4b7ba800a878d5b2e40b is deleted. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Marking volume f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 as bootable. {{(pid=83041) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Copying metadata from image 62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0 to f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0. {{(pid=83041) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Creating volume glance metadata for volume f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 backed by image 62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0 with: {'image_id': '62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'image_name': 'tempest-scenario-img--99959056', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83041) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79fa76fa-1f30-4223-85c6-da8447e28eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0', 'volume_size': 1, 'image_id': '62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--99959056', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f916047da9d144ce862622c0a3e68aa6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0', 'created_at': datetime.datetime(2025, 9, 15, 23, 43, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 43, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/62fcbfa6-7f9c-49f1-ae45-97be1a25b9a0/file', 'properties': {}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860c4ca7-3272-43cf-891d-33d9c33db28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:40 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 (f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0): created successfully Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (860c4ca7-3272-43cf-891d-33d9c33db28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Flow 'volume_create_manager' (27be1731-f3c1-4fb7-90d6-3427f9347046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-69dc9f48-3789-49dc-8b3e-f0974c4126ee tempest-TestInstancesWithCinderVolumes-1827331666 None] Created volume successfully. Sep 16 01:43:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:42 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:43:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Flow 'volume_create_manager' (e7e2e67d-9a91-4321-b018-d3b15a3c6e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7035fc5-2f19-4007-b7a7-644f5886ea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7035fc5-2f19-4007-b7a7-644f5886ea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1090285091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3a36bb-84c2-4ea2-96d3-9e0827ac463a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b8f3dd9f5f4c2196b89a119aa461b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:43Z,use_quota=True,user_id='5de16586d905415a9b1012013b136ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cfefda-e097-4b75-a0e2-bb0f0327d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78cfefda-e097-4b75-a0e2-bb0f0327d78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c234f8-c83a-4450-9070-45c4bd8938fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:42 devstack cinder-volume[83041]: DEBUG cinder.image.glance [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Creating Keystone auth plugin from conf {{(pid=83041) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 01:43:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c234f8-c83a-4450-9070-45c4bd8938fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db3a36bb-84c2-4ea2-96d3-9e0827ac463a', 'volume_name': 'volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311cb714-bcb0-4194-beb9-04eeb45ec12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311cb714-bcb0-4194-beb9-04eeb45ec12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad025d91-07ff-431f-9c50-c808a3a75176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:43 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Volume db3a36bb-84c2-4ea2-96d3-9e0827ac463a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 01:43:43 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Cloning db3a36bb-84c2-4ea2-96d3-9e0827ac463a from image 4fb31587-8398-4719-bd55-69963b8198da at location (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]). {{(pid=83041) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 01:43:43 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 01:43:43 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Image download 20.69 MB at 20.69 MB/s Sep 16 01:43:43 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebbef47-2d68-483e-b824-b8bf398b7505]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:43 devstack sudo[92788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD Sep 16 01:43:43 devstack sudo[92788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:43:45 devstack sudo[92788]: pam_unix(sudo:session): session closed for user root Sep 16 01:43:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD" returned: 0 in 2.033s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:45 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Temporary image 4fb31587-8398-4719-bd55-69963b8198da is fetched for user 5de16586d905415a9b1012013b136ae6. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 01:43:45 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2999d85e-974a-4a5c-ad63-05ad7339f292]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:46 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD Sep 16 01:43:46 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:43:47 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Sep 16 01:43:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD" returned: 0 in 1.970s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1090285091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db3a36bb-84c2-4ea2-96d3-9e0827ac463a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b8f3dd9f5f4c2196b89a119aa461b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:43:43Z,use_quota=True,user_id='5de16586d905415a9b1012013b136ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Creating volume db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:43:48 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:48 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=74, name=volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a 1073741824" returned: 0 in 0.364s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] <== create_volume: return (597ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.636s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:48 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Attempting download of 4fb31587-8398-4719-bd55-69963b8198da ((None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}])) to volume db3a36bb-84c2-4ea2-96d3-9e0827ac463a. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 01:43:49 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd050ce-26fd-42d8-bf57-52bdb8bdad30]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_9gi0_1pm {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_9gi0_1pm" returned: 0 in 0.570s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_9gi0_1pm {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_9gi0_1pm" returned: 1 in 0.711s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_9gi0_1pm' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:50 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c130d3-2486-43a3-9f38-5cde4482a356]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:51 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[729d3bcc-39cd-46a8-bc1d-74bb72a4eda7]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD" returned: 0 in 0.824s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:51 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] 4fb31587-8398-4719-bd55-69963b8198da was qcow2, converting to raw {{(pid=83041) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 01:43:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:51 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=74, name=volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:43:51 devstack quobyte-client[83066]: System call of process 92819 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 0 in 0.635s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 1 in 0.532s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.343s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 0 in 1.242s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:52 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_bqyprj1adevstack@QuobyteHD, size 112.00 MB, duration 1.25 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:43:52 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Converted 112.00 MB image at 89.81 MB/s Sep 16 01:43:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:52 devstack quobyte-client[83066]: System call of process 92858 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a 1G" returned: 0 in 0.302s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba41dce1-f5fa-4bf9-9552-0f279fcdeb61', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:43:53 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd9a718-b39f-4615-b673-c55d62cc1a08]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:53 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-2fcf6c89-5517-47af-8324-1224c55a8033 tempest-TestInstancesWithCinderVolumes-1827331666 None] attachment_update completed successfully. Sep 16 01:43:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 0 in 0.604s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 1 in 0.410s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Downloaded image 4fb31587-8398-4719-bd55-69963b8198da ((None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}])) to volume db3a36bb-84c2-4ea2-96d3-9e0827ac463a successfully. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Temporary image 4fb31587-8398-4719-bd55-69963b8198da for user 5de16586d905415a9b1012013b136ae6 is deleted. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Marking volume db3a36bb-84c2-4ea2-96d3-9e0827ac463a as bootable. {{(pid=83041) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Copying metadata from image 4fb31587-8398-4719-bd55-69963b8198da to db3a36bb-84c2-4ea2-96d3-9e0827ac463a. {{(pid=83041) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Creating volume glance metadata for volume db3a36bb-84c2-4ea2-96d3-9e0827ac463a backed by image 4fb31587-8398-4719-bd55-69963b8198da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83041) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad025d91-07ff-431f-9c50-c808a3a75176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca08ecc-e6f6-4ad2-8e75-ca44fadc0c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:43:54 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Volume volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a (db3a36bb-84c2-4ea2-96d3-9e0827ac463a): created successfully Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ca08ecc-e6f6-4ad2-8e75-ca44fadc0c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:43:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Flow 'volume_create_manager' (e7e2e67d-9a91-4321-b018-d3b15a3c6e63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:43:54 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5d51f1bc-3592-4574-b926-b79c1b03d3ad tempest-VolumesExtendTest-1341886883 None] Created volume successfully. Sep 16 01:43:55 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:43:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:43:55 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4803e455-3223-406d-8690-a4245199b483]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 0 in 0.537s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 1 in 0.361s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a 2G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a 2G" returned: 0 in 0.130s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.229s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:43:57 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=61,cinder:UPDATE=35,cinder:DELETE=4,cinder:INSERT=19 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:43:57 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-c23be7b6-c5e1-440c-9e87-b4ed3f272959 tempest-VolumesExtendTest-1341886883 None] Extend volume completed successfully. Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "cinder-db3a36bb-84c2-4ea2-96d3-9e0827ac463a-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-db3a36bb-84c2-4ea2-96d3-9e0827ac463a-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=46,cinder:SELECT=39,cinder:INSERT=24,cinder:DELETE=5 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:43:58 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "cinder-quobyte-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-quobyte-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" acquired by "delete_volume" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[870e3f21-89ef-4841-b520-d2a8d683306c]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 0 in 0.401s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:59 devstack quobyte-client[83066]: System call of process 92880 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:43:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 1 in 0.490s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:43:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:43:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" returned: 0 in 0.091s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:43:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-quobyte-db3a36bb-84c2-4ea2-96d3-9e0827ac463a" released by "delete_volume" :: held 1.243s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:43:59 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Created reservations ['5ea00550-831b-427e-b19e-ec8265565985', 'f07b8a9c-aa0c-45bc-8ac6-34bc8e584865', '6782cf54-c282-42d8-a83d-b01f98a04917', '5e10caf1-0633-4212-ba66-2dd40eb59387'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.101s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:44:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Deleted volume successfully. Sep 16 01:44:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-71768db5-8dbb-471e-b8c3-88a2b204e029 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-db3a36bb-84c2-4ea2-96d3-9e0827ac463a-delete_volume" released by "delete_volume" :: held 2.501s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Flow 'volume_create_manager' (efc3c508-a0d7-4d42-9384-574e8a6cc865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7300cf-60aa-4fde-ba98-8dbc90f1c49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd7300cf-60aa-4fde-ba98-8dbc90f1c49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-918839838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646e8800-b97a-4831-9252-c5ff9c270a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b8f3dd9f5f4c2196b89a119aa461b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:44:01Z,use_quota=True,user_id='5de16586d905415a9b1012013b136ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b959188e-9565-4bf0-b047-d7ec23dae17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b959188e-9565-4bf0-b047-d7ec23dae17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99182ea9-4cbf-4645-8f86-dca16420b695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99182ea9-4cbf-4645-8f86-dca16420b695) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646e8800-b97a-4831-9252-c5ff9c270a8a', 'volume_name': 'volume-646e8800-b97a-4831-9252-c5ff9c270a8a', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea99737-dd14-4fbf-a02a-83023047df19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bea99737-dd14-4fbf-a02a-83023047df19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67d7dca-928c-4050-b34e-b85e163e4a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:01 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Volume 646e8800-b97a-4831-9252-c5ff9c270a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646e8800-b97a-4831-9252-c5ff9c270a8a', 'volume_size': 1} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-918839838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646e8800-b97a-4831-9252-c5ff9c270a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b8f3dd9f5f4c2196b89a119aa461b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:44:01Z,use_quota=True,user_id='5de16586d905415a9b1012013b136ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Creating volume 646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:44:01 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:44:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:01 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=75, name=volume-646e8800-b97a-4831-9252-c5ff9c270a8a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:44:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a 1073741824" returned: 0 in 0.758s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:03 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-a8cd4a13-dbe8-4aec-8edd-9c29a1d660f0 req-ef69a3a5-077a-4600-afbc-3f6e79a7a729 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a" returned: 0 in 1.323s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] <== create_volume: return (2260ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:44:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.275s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:03 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-a8cd4a13-dbe8-4aec-8edd-9c29a1d660f0 req-ef69a3a5-077a-4600-afbc-3f6e79a7a729 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:03 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-a8cd4a13-dbe8-4aec-8edd-9c29a1d660f0 req-ef69a3a5-077a-4600-afbc-3f6e79a7a729 tempest-AttachVolumeNegativeTest-678661232 None] Terminate volume connection completed successfully. Sep 16 01:44:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-a8cd4a13-dbe8-4aec-8edd-9c29a1d660f0 req-ef69a3a5-077a-4600-afbc-3f6e79a7a729 tempest-AttachVolumeNegativeTest-678661232 None] Deleting attachment ae602040-7f7f-4de9-b381-5a6ce5b81327. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67d7dca-928c-4050-b34e-b85e163e4a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646e8800-b97a-4831-9252-c5ff9c270a8a', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccc2d04-8a77-4e77-922e-32a4a6895ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:04 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Volume volume-646e8800-b97a-4831-9252-c5ff9c270a8a (646e8800-b97a-4831-9252-c5ff9c270a8a): created successfully Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ccc2d04-8a77-4e77-922e-32a4a6895ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Flow 'volume_create_manager' (efc3c508-a0d7-4d42-9384-574e8a6cc865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:44:04 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-536422f3-fc9b-4b47-9276-389224e1deeb tempest-VolumesExtendTest-1341886883 None] Created volume successfully. Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.221s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:44:05 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-182f1ab8-108a-4818-82c7-7952feb03c28 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:05 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-182f1ab8-108a-4818-82c7-7952feb03c28 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:05 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-182f1ab8-108a-4818-82c7-7952feb03c28 tempest-TestInstancesWithCinderVolumes-1827331666 None] Terminate volume connection completed successfully. Sep 16 01:44:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-16b6735a-a25b-4526-8e43-942c9ff30ee0 req-182f1ab8-108a-4818-82c7-7952feb03c28 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deleting attachment ba41dce1-f5fa-4bf9-9552-0f279fcdeb61. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:44:05 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Creating offline snapshot 8bfc94aa-26e8-4d8d-a058-16e0077bdb14 of volume 646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:44:05 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd95ef-9c8b-4462-bc3f-23424ce7ad00]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:44:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:06 devstack quobyte-client[83066]: System call of process 92968 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:44:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a" returned: 0 in 0.813s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:07 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=76, name=volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:44:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 1G" returned: 0 in 0.560s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img rebase -u -b volume-646e8800-b97a-4831-9252-c5ff9c270a8a -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:08 devstack quobyte-client[83066]: System call of process 92999 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img rebase -u -b volume-646e8800-b97a-4831-9252-c5ff9c270a8a -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14" returned: 0 in 0.698s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14" returned: 0 in 0.192s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14" returned: 0 in 0.201s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.info" returned: 0 in 0.119s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:44:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.info" returned: 0 in 0.264s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.599s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8148c295-6e04-45b3-820e-e926f6cfb18e tempest-VolumesExtendTest-1341886883 None] Create snapshot completed successfully Sep 16 01:44:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:11 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[525f1927-48f3-4c15-9e7e-feae56249589]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:44:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a" returned: 0 in 0.699s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 2G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:12 devstack quobyte-client[83066]: System call of process 93043 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:44:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 2G" returned: 0 in 0.386s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.290s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-94e51f7f-1377-4e30-9d9b-82e55c862496 tempest-VolumesExtendTest-1341886883 None] Extend volume completed successfully. Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "cinder-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:13 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "cinder-quobyte-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-quobyte-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" acquired by "delete_volume" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "cinder-8bfc94aa-26e8-4d8d-a058-16e0077bdb14-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847fe7f-b7ec-4ba3-9303-23f7455bbf1b]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-8bfc94aa-26e8-4d8d-a058-16e0077bdb14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.202s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:13 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "cinder-quobyte-646e8800-b97a-4831-9252-c5ff9c270a8a" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-quobyte-646e8800-b97a-4831-9252-c5ff9c270a8a" acquired by "delete_snapshot" :: waited 0.031s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "cinder-quobyte-8bfc94aa-26e8-4d8d-a058-16e0077bdb14" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-quobyte-8bfc94aa-26e8-4d8d-a058-16e0077bdb14" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Deleting offline snapshot 8bfc94aa-26e8-4d8d-a058-16e0077bdb14 of volume 646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] snapshot_file for this snap is: volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e280b5be-21df-40a0-b18a-7d4cad7caa0e]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:44:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 0 in 0.528s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:14 devstack quobyte-client[83066]: System call of process 93048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14" returned: 0 in 0.521s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646e8800-b97a-4831-9252-c5ff9c270a8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[787c364a-51a5-4e47-85f6-f75b70b128cd]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 1 in 0.552s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" returned: 0 in 0.089s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-quobyte-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0" released by "delete_volume" :: held 1.443s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:15 devstack quobyte-client[83066]: System call of process 93054 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:44:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a" returned: 0 in 0.631s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14" returned: 0 in 0.291s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:15 devstack cinder-volume[83041]: WARNING cinder.quota [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1840152718-1581130157 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1840152718-1581130157, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:44:15 devstack cinder-volume[83041]: WARNING cinder.quota [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1840152718-1581130157 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1840152718-1581130157, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:44:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a.8bfc94aa-26e8-4d8d-a058-16e0077bdb14" returned: 0 in 0.347s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-quobyte-8bfc94aa-26e8-4d8d-a058-16e0077bdb14" released by "_delete_snapshot" :: held 2.058s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-quobyte-646e8800-b97a-4831-9252-c5ff9c270a8a" released by "delete_snapshot" :: held 2.095s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:15 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Created reservations ['a8cb1458-7cf6-4720-8af7-c3417570ba58', 'd64d808c-0b97-4bf0-86c5-ae6851f2b459', 'dbdcfba7-37e4-47e2-9550-7e6f7484b53a', '0c66b5ca-4cca-42a0-8acb-bc768c41864f'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Created reservations ['efcd5d93-b76d-4980-a260-95de170924e0', '8332d277-5661-4b80-b946-b5ea0dbc6eab', 'abccb949-7845-40a3-97a1-53eb3ad23318', '0dac54b3-d98e-40a3-bba3-3e8d6074c8c0'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.286s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:44:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Delete snapshot completed successfully. Sep 16 01:44:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deleted volume successfully. Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-804f3cd6-936a-4f6a-950e-ba79907b1fa4 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-8bfc94aa-26e8-4d8d-a058-16e0077bdb14-delete_snapshot" released by "delete_snapshot" :: held 2.832s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e729e6e0-e5e2-482d-97fe-c6a7ea0736e7 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-f0ec4dd5-3102-44bc-81ac-3e0719aa1dd0-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "cinder-85b43f9c-234f-4c05-a851-69cb35b8354e-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-85b43f9c-234f-4c05-a851-69cb35b8354e-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:16 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "cinder-quobyte-85b43f9c-234f-4c05-a851-69cb35b8354e" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "cinder-646e8800-b97a-4831-9252-c5ff9c270a8a-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-quobyte-85b43f9c-234f-4c05-a851-69cb35b8354e" acquired by "delete_volume" :: waited 0.017s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-646e8800-b97a-4831-9252-c5ff9c270a8a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c6025d-d2de-452f-9c88-3ade9e506719]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85b43f9c-234f-4c05-a851-69cb35b8354e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:17 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "cinder-quobyte-646e8800-b97a-4831-9252-c5ff9c270a8a" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-quobyte-646e8800-b97a-4831-9252-c5ff9c270a8a" acquired by "delete_volume" :: waited 0.070s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b702055a-6b36-4a75-9565-fcb8fed161e0]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85b43f9c-234f-4c05-a851-69cb35b8354e" returned: 0 in 0.705s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85b43f9c-234f-4c05-a851-69cb35b8354e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85b43f9c-234f-4c05-a851-69cb35b8354e" returned: 0 in 0.219s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:18 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-quobyte-85b43f9c-234f-4c05-a851-69cb35b8354e" released by "delete_volume" :: held 1.246s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a" returned: 0 in 0.837s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-646e8800-b97a-4831-9252-c5ff9c270a8a" returned: 0 in 0.369s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:18 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-quobyte-646e8800-b97a-4831-9252-c5ff9c270a8a" released by "delete_volume" :: held 1.337s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:18 devstack cinder-volume[83041]: WARNING cinder.quota [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1466638532-322065415 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1466638532-322065415, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:44:18 devstack cinder-volume[83041]: WARNING cinder.quota [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1466638532-322065415 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1466638532-322065415, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Created reservations ['ea36c24a-10b6-4ed4-882b-76063380a574', '72337190-a922-4907-9729-5234bd9ee046', '12062df0-693c-4108-921d-e6faa600c434', '938ea310-f304-40dd-ba0f-7b4b9d34e867'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Created reservations ['b4f0a571-23e2-48ac-a2a9-b76b285daeda', 'f8a75e44-2cbd-4be3-9a42-204216a597eb', '14d86fe7-5e59-49a3-8d6d-2e4c9977deac', 'fcf6d864-f884-4ead-8758-4230c31fd362'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.200s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:44:19 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deleted volume successfully. Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.217s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:44:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2a2ba7f0-b969-4a1e-8a20-aee80a976895 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-85b43f9c-234f-4c05-a851-69cb35b8354e-delete_volume" released by "delete_volume" :: held 3.169s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:20 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Deleted volume successfully. Sep 16 01:44:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6109324b-25b4-4dc4-9382-36a98f1728d5 tempest-VolumesExtendTest-1341886883 None] Lock "cinder-646e8800-b97a-4831-9252-c5ff9c270a8a-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "cinder-3d014018-2841-432d-8a71-3a946f10ef01-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-3d014018-2841-432d-8a71-3a946f10ef01-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:20 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "cinder-quobyte-3d014018-2841-432d-8a71-3a946f10ef01" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:44:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-quobyte-3d014018-2841-432d-8a71-3a946f10ef01" acquired by "delete_volume" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:44:20 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7156c238-329f-4baa-8b49-705691ad0f19]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:44:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3d014018-2841-432d-8a71-3a946f10ef01 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3d014018-2841-432d-8a71-3a946f10ef01" returned: 0 in 0.485s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3d014018-2841-432d-8a71-3a946f10ef01 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-3d014018-2841-432d-8a71-3a946f10ef01" returned: 0 in 0.157s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-quobyte-3d014018-2841-432d-8a71-3a946f10ef01" released by "delete_volume" :: held 0.890s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:21 devstack cinder-volume[83041]: WARNING cinder.quota [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437080309-50026130 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437080309-50026130, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:44:21 devstack cinder-volume[83041]: WARNING cinder.quota [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437080309-50026130 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1437080309-50026130, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Created reservations ['aea823fb-938b-4cde-b819-82e9b16152da', '1f027ae0-6c49-403d-9ce6-aacb482a936b', 'b25e17c0-9671-42e9-acbc-e1a0ebd881bf', '36392da1-2e54-4d68-a0c5-d8e5cf957164'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:44:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.119s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:22 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:44:22 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Deleted volume successfully. Sep 16 01:44:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b6ce6f97-100c-4796-966a-436de4372716 tempest-TestInstancesWithCinderVolumes-1827331666 None] Lock "cinder-3d014018-2841-432d-8a71-3a946f10ef01-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:44:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Flow 'volume_create_manager' (50034ef5-273f-4b36-a041-5a8c5b51e0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d12eb7-e1e9-4622-9355-92cb90751cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42d12eb7-e1e9-4622-9355-92cb90751cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-774678954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1183ca29-9b7a-49ff-97ed-882fdc44b148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d97647880541e0b3f36bec73230cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:44:24Z,use_quota=True,user_id='258678ad399f480886d86489989023c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dde58c4-956d-4a6a-91d8-170014b8f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dde58c4-956d-4a6a-91d8-170014b8f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eec408-2058-44f4-9b93-fb1fd60a7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72eec408-2058-44f4-9b93-fb1fd60a7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1183ca29-9b7a-49ff-97ed-882fdc44b148', 'volume_name': 'volume-1183ca29-9b7a-49ff-97ed-882fdc44b148', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ad3ca1-0ac2-48a5-89dd-e09abe1ce9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69ad3ca1-0ac2-48a5-89dd-e09abe1ce9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a787515-8726-4e37-a15e-baa1329ef2c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:24 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Volume 1183ca29-9b7a-49ff-97ed-882fdc44b148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1183ca29-9b7a-49ff-97ed-882fdc44b148', 'volume_size': 1} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:44:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-774678954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1183ca29-9b7a-49ff-97ed-882fdc44b148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7d97647880541e0b3f36bec73230cd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:44:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:44:24Z,use_quota=True,user_id='258678ad399f480886d86489989023c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Creating volume 1183ca29-9b7a-49ff-97ed-882fdc44b148 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:44:24 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:44:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1183ca29-9b7a-49ff-97ed-882fdc44b148 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:25 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=78, name=volume-1183ca29-9b7a-49ff-97ed-882fdc44b148, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:44:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1183ca29-9b7a-49ff-97ed-882fdc44b148 1073741824" returned: 0 in 0.591s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1183ca29-9b7a-49ff-97ed-882fdc44b148 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:44:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1183ca29-9b7a-49ff-97ed-882fdc44b148" returned: 0 in 0.179s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:44:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] <== create_volume: return (890ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:44:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:44:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a787515-8726-4e37-a15e-baa1329ef2c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1183ca29-9b7a-49ff-97ed-882fdc44b148', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056bda9f-acd8-47dd-8d54-7e35401295e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:44:26 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Volume volume-1183ca29-9b7a-49ff-97ed-882fdc44b148 (1183ca29-9b7a-49ff-97ed-882fdc44b148): created successfully Sep 16 01:44:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056bda9f-acd8-47dd-8d54-7e35401295e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:44:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Flow 'volume_create_manager' (50034ef5-273f-4b36-a041-5a8c5b51e0bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:44:26 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-56c40e94-ada2-48be-b7a3-fb633d9f06ac tempest-VolumesNegativeTest-1766592207 None] Created volume successfully. Sep 16 01:44:36 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=31,cinder:INSERT=18,cinder:UPDATE=49,cinder:DELETE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:44:36 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=43,cinder:INSERT=6,cinder:UPDATE=57,cinder:DELETE=5 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:45:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:45:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:45:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:45:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:45:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.394s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:45:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Acquiring lock "cinder-1183ca29-9b7a-49ff-97ed-882fdc44b148-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:45:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Lock "cinder-1183ca29-9b7a-49ff-97ed-882fdc44b148-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:45:27 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:45:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Acquiring lock "cinder-quobyte-1183ca29-9b7a-49ff-97ed-882fdc44b148" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:45:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Lock "cinder-quobyte-1183ca29-9b7a-49ff-97ed-882fdc44b148" acquired by "delete_volume" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:45:27 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d117e81-9c00-4c2a-b807-c97784fd6a78]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:45:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1183ca29-9b7a-49ff-97ed-882fdc44b148 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1183ca29-9b7a-49ff-97ed-882fdc44b148" returned: 0 in 0.557s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1183ca29-9b7a-49ff-97ed-882fdc44b148 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1183ca29-9b7a-49ff-97ed-882fdc44b148" returned: 0 in 0.118s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Lock "cinder-quobyte-1183ca29-9b7a-49ff-97ed-882fdc44b148" released by "delete_volume" :: held 0.853s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:45:28 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Created reservations ['9113440b-6d97-418f-991f-065c53af6526', '813699fd-0200-4686-a897-53e672c1e337', 'a698563a-e577-477e-be61-f55da8872237', '757490a9-8f70-4fca-b141-323b8524784a'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.161s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:45:29 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Deleted volume successfully. Sep 16 01:45:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-57019bf4-d1eb-4c41-bfc3-d17c6c6c0de5 tempest-VolumesNegativeTest-1766592207 None] Lock "cinder-1183ca29-9b7a-49ff-97ed-882fdc44b148-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:45:33 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:45:33 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:45:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Flow 'volume_create_manager' (d1a99ae1-1797-4909-9ab7-d13b52338b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:45:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b54c1a-a968-497d-941b-729377e88dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b54c1a-a968-497d-941b-729377e88dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-285542895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2341fa-c99d-430f-b07b-2252dcec6bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f896bddfdd82477b918e69ff338b2148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:45:34Z,use_quota=True,user_id='96680f931d1b41cfa4c94298777e44ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebcdc80-80ef-422a-8150-4410a2c95fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bebcdc80-80ef-422a-8150-4410a2c95fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c634743-7005-453d-a543-e87c7788d268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c634743-7005-453d-a543-e87c7788d268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2341fa-c99d-430f-b07b-2252dcec6bde', 'volume_name': 'volume-db2341fa-c99d-430f-b07b-2252dcec6bde', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86522f12-af96-4249-aec5-b6f544fc706d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86522f12-af96-4249-aec5-b6f544fc706d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8faaa3-9028-426f-8b76-084c5d15c891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:34 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume db2341fa-c99d-430f-b07b-2252dcec6bde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2341fa-c99d-430f-b07b-2252dcec6bde', 'volume_size': 1} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-285542895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2341fa-c99d-430f-b07b-2252dcec6bde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f896bddfdd82477b918e69ff338b2148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:45:34Z,use_quota=True,user_id='96680f931d1b41cfa4c94298777e44ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Creating volume db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:45:34 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:34 devstack quobyte-client[83066]: System call of process 93442 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:45:34 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=79, name=volume-db2341fa-c99d-430f-b07b-2252dcec6bde, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde 1073741824" returned: 0 in 0.584s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde" returned: 0 in 0.158s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] <== create_volume: return (901ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:45:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:45:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b8faaa3-9028-426f-8b76-084c5d15c891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2341fa-c99d-430f-b07b-2252dcec6bde', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62857a22-f290-48dd-8d2f-40d743adb40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:35 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume volume-db2341fa-c99d-430f-b07b-2252dcec6bde (db2341fa-c99d-430f-b07b-2252dcec6bde): created successfully Sep 16 01:45:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62857a22-f290-48dd-8d2f-40d743adb40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Flow 'volume_create_manager' (d1a99ae1-1797-4909-9ab7-d13b52338b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:45:35 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0a96c7af-3f80-4b87-9953-5474abd039c9 tempest-VolumesSnapshotListTestJSON-1101085925 None] Created volume successfully. Sep 16 01:45:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:45:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Creating offline snapshot 1b11308a-474b-46ad-96e9-b2f5282d642f of volume db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:45:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0e5896-edd7-4c96-a3f3-05cce67bea07]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:45:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde" returned: 0 in 0.764s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:37 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=80, name=volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:45:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f 1G" returned: 0 in 0.446s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img rebase -u -b volume-db2341fa-c99d-430f-b07b-2252dcec6bde -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img rebase -u -b volume-db2341fa-c99d-430f-b07b-2252dcec6bde -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f" returned: 0 in 0.368s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f" returned: 0 in 0.143s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f" returned: 0 in 0.185s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.info" returned: 0 in 0.274s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:45:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.info" returned: 0 in 0.311s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.397s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:45:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ea7fcf69-daee-481d-98dd-1af86b60edfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Create snapshot completed successfully Sep 16 01:45:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:45:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Creating offline snapshot 5e1943cf-3565-4d2d-8259-379455875f13 of volume db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:45:41 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c4a37f-244d-4b48-9449-8d8c909371c1]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:45:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f" returned: 0 in 0.700s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2341fa-c99d-430f-b07b-2252dcec6bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:42 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=82, name=volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 1G" returned: 0 in 0.323s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img rebase -u -b volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:42 devstack quobyte-client[83066]: System call of process 93504 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img rebase -u -b volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13" returned: 0 in 0.159s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13" returned: 0 in 0.124s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13" returned: 0 in 0.095s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.794s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:45:43 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-9bdbd219-039b-4c2c-bb08-e14e6b009973 tempest-VolumesSnapshotListTestJSON-1101085925 None] Create snapshot completed successfully Sep 16 01:45:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:45:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Creating offline snapshot 11dd5ddb-9112-4a00-ab10-3f10a396ed2d of volume db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:45:44 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be84753-adb7-4f45-b7c7-fd74ae1b0899]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:45:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:45 devstack quobyte-client[83066]: System call of process 93527 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:45:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13" returned: 0 in 0.664s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2341fa-c99d-430f-b07b-2252dcec6bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:45:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:46 devstack quobyte-client[83066]: System call of process 93536 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:45:46 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=83, name=volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:45:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d 1G" returned: 0 in 0.995s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img rebase -u -b volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:47 devstack quobyte-client[83066]: System call of process 93563 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:45:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img rebase -u -b volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d" returned: 0 in 0.773s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:45:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d" returned: 0 in 0.282s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:45:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d" returned: 0 in 0.252s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.796s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:45:49 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1a3bee3a-27b6-43f2-8183-8bc71b8fc593 tempest-VolumesSnapshotListTestJSON-1101085925 None] Create snapshot completed successfully Sep 16 01:45:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-11dd5ddb-9112-4a00-ab10-3f10a396ed2d-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:45:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-11dd5ddb-9112-4a00-ab10-3f10a396ed2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.122s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:45:52 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:45:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:45:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" acquired by "delete_snapshot" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-quobyte-11dd5ddb-9112-4a00-ab10-3f10a396ed2d" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-11dd5ddb-9112-4a00-ab10-3f10a396ed2d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Deleting offline snapshot 11dd5ddb-9112-4a00-ab10-3f10a396ed2d of volume db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] snapshot_file for this snap is: volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff50644-c319-4f76-b633-091e99ad84da]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d" returned: 0 in 0.446s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2341fa-c99d-430f-b07b-2252dcec6bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0c99a3-fb2b-4aeb-85bb-551fa14ea99c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:45:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:54 devstack quobyte-client[83066]: System call of process 93618 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:45:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13" returned: 0 in 0.642s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2341fa-c99d-430f-b07b-2252dcec6bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:45:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:54 devstack quobyte-client[83066]: System call of process 93622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:45:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d" returned: 0 in 0.279s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.11dd5ddb-9112-4a00-ab10-3f10a396ed2d" returned: 0 in 0.193s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-11dd5ddb-9112-4a00-ab10-3f10a396ed2d" released by "_delete_snapshot" :: held 1.853s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:45:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" released by "delete_snapshot" :: held 1.886s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:45:55 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Created reservations ['72fb5151-35c6-4b7d-9b8e-8ca77d8f4fcf', '8f100120-36c4-49c8-bd6d-a6a88edf78bb', '165635b7-39c9-4ac0-bca3-b60e57f7a5f8', '47c3eaf5-6eed-4f3a-a0f8-44789bbe3b7e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:45:55 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Delete snapshot completed successfully. Sep 16 01:45:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-661d3297-c44d-49e1-aa8e-888c11da15f2 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-11dd5ddb-9112-4a00-ab10-3f10a396ed2d-delete_snapshot" released by "delete_snapshot" :: held 2.673s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-5e1943cf-3565-4d2d-8259-379455875f13-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-5e1943cf-3565-4d2d-8259-379455875f13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:45:56 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-quobyte-5e1943cf-3565-4d2d-8259-379455875f13" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-5e1943cf-3565-4d2d-8259-379455875f13" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Deleting offline snapshot 5e1943cf-3565-4d2d-8259-379455875f13 of volume db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] snapshot_file for this snap is: volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb8bf85-a318-4918-bab7-42f9790bb428]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:45:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13" returned: 0 in 0.625s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2341fa-c99d-430f-b07b-2252dcec6bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:45:57 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b27189-4053-484d-bc88-db8103ba098e]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:45:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f" returned: 0 in 0.771s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2341fa-c99d-430f-b07b-2252dcec6bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:45:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13" returned: 0 in 0.501s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.5e1943cf-3565-4d2d-8259-379455875f13" returned: 0 in 0.167s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-5e1943cf-3565-4d2d-8259-379455875f13" released by "_delete_snapshot" :: held 2.755s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" released by "delete_snapshot" :: held 2.977s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:45:59 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Flow 'volume_create_manager' (636b82b9-e84a-422b-bcb4-d81f418bf496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d8f823-c605-4113-a2d6-42716a41fd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d8f823-c605-4113-a2d6-42716a41fd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1577365345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02718319-58ad-4379-be4c-f04bdb866f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cdfdcf638742488c2268c270626dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:45:59Z,use_quota=True,user_id='03c45a155a044c308f9fb7f3cd7f5fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3567c74c-2e05-4637-b352-1c3a64a36bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3567c74c-2e05-4637-b352-1c3a64a36bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60289764-cc25-4fe7-b29b-aa6805adfce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60289764-cc25-4fe7-b29b-aa6805adfce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02718319-58ad-4379-be4c-f04bdb866f13', 'volume_name': 'volume-02718319-58ad-4379-be4c-f04bdb866f13', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b4fca7-e20f-4599-8c30-1cc3de7780cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3b4fca7-e20f-4599-8c30-1cc3de7780cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db60c5f-a081-45da-afaa-c6e5af536d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:45:59 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Volume 02718319-58ad-4379-be4c-f04bdb866f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02718319-58ad-4379-be4c-f04bdb866f13', 'volume_size': 1} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:45:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1577365345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02718319-58ad-4379-be4c-f04bdb866f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00cdfdcf638742488c2268c270626dd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:45:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:45:59Z,use_quota=True,user_id='03c45a155a044c308f9fb7f3cd7f5fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Creating volume 02718319-58ad-4379-be4c-f04bdb866f13 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:45:59 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:45:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:45:59 devstack quobyte-client[83066]: System call of process 93637 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:45:59 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=84, name=volume-02718319-58ad-4379-be4c-f04bdb866f13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Created reservations ['ebb9ec1a-8071-4c20-b091-d7e9c6fae7c4', '581bfe6b-dcd3-4495-9c28-ec72246210b0', 'd29c5957-39f0-44f2-aa3e-4a82995b11ac', 'a90ee38c-40d3-4bf6-b30c-4de105d5d91e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13 1073741824" returned: 0 in 0.628s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Delete snapshot completed successfully. Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13" returned: 0 in 0.197s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] <== create_volume: return (845ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66967ebd-82d8-4100-86f5-39bf980d7853 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-5e1943cf-3565-4d2d-8259-379455875f13-delete_snapshot" released by "delete_snapshot" :: held 4.282s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db60c5f-a081-45da-afaa-c6e5af536d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02718319-58ad-4379-be4c-f04bdb866f13', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df44e10-0f6e-4901-ad7a-56e6cdc4f59f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-1b11308a-474b-46ad-96e9-b2f5282d642f-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-1b11308a-474b-46ad-96e9-b2f5282d642f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:00 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:00 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Volume volume-02718319-58ad-4379-be4c-f04bdb866f13 (02718319-58ad-4379-be4c-f04bdb866f13): created successfully Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0df44e10-0f6e-4901-ad7a-56e6cdc4f59f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Flow 'volume_create_manager' (636b82b9-e84a-422b-bcb4-d81f418bf496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" acquired by "delete_snapshot" :: waited 0.046s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-quobyte-1b11308a-474b-46ad-96e9-b2f5282d642f" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-1b11308a-474b-46ad-96e9-b2f5282d642f" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Deleting offline snapshot 1b11308a-474b-46ad-96e9-b2f5282d642f of volume db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] snapshot_file for this snap is: volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:46:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4eaee282-87d5-49b1-9498-964c915138b6 tempest-TestMinimumBasicScenario-1044707550 None] Created volume successfully. Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb0716c-84cd-4891-926d-a6fa47dc9e38]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f" returned: 0 in 0.755s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db2341fa-c99d-430f-b07b-2252dcec6bde(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:46:01 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d110ea-0792-4a80-a171-7e20f85955ea]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde" returned: 0 in 0.507s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f" returned: 0 in 0.236s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde.1b11308a-474b-46ad-96e9-b2f5282d642f" returned: 0 in 0.115s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-1b11308a-474b-46ad-96e9-b2f5282d642f" released by "_delete_snapshot" :: held 1.978s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" released by "delete_snapshot" :: held 2.002s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:03 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Created reservations ['d42d538b-f759-4fd8-912c-89c5ccd510cf', '850fbc03-76f4-4347-864f-e0962bd885da', '37e122f0-1ee6-4490-946a-013b4efad903', '0af950e7-d117-48e1-bf7e-26c92488d833'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:46:03 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Delete snapshot completed successfully. Sep 16 01:46:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-358a7dc1-0c16-4ee7-a4e1-a42314c14dfb tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-1b11308a-474b-46ad-96e9-b2f5282d642f-delete_snapshot" released by "delete_snapshot" :: held 2.526s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-db2341fa-c99d-430f-b07b-2252dcec6bde-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-db2341fa-c99d-430f-b07b-2252dcec6bde-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:05 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" acquired by "delete_volume" :: waited 0.204s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.822s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:46:05 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[c368324f-89dd-4ab3-8fef-7662c6f9ed54]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:06 devstack quobyte-client[83066]: System call of process 93661 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:46:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde" returned: 0 in 0.963s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5c65bf35-3c1a-400f-b560-2ae419ecbbc7 req-de7b48ca-712d-43a5-9ab6-3ce3b3f6d06c tempest-TestMinimumBasicScenario-1044707550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5c65bf35-3c1a-400f-b560-2ae419ecbbc7 req-de7b48ca-712d-43a5-9ab6-3ce3b3f6d06c tempest-TestMinimumBasicScenario-1044707550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.022s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:06 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[28753829-6f28-4811-b841-667fa78eb32a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5c65bf35-3c1a-400f-b560-2ae419ecbbc7 req-de7b48ca-712d-43a5-9ab6-3ce3b3f6d06c tempest-TestMinimumBasicScenario-1044707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-db2341fa-c99d-430f-b07b-2252dcec6bde" returned: 0 in 0.319s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:07 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-quobyte-db2341fa-c99d-430f-b07b-2252dcec6bde" released by "delete_volume" :: held 1.902s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Created reservations ['a0526382-5528-4aed-9277-dbde8cf076d7', 'ebd2576a-a24c-4e76-a08c-c7dd246cc1b6', '64c8f9af-96ce-41d8-ba4b-851cbf6a6102', 'e2062ac7-6b37-4f04-8c3c-96c4fb4303be'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-5c65bf35-3c1a-400f-b560-2ae419ecbbc7 req-de7b48ca-712d-43a5-9ab6-3ce3b3f6d06c tempest-TestMinimumBasicScenario-1044707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13" returned: 0 in 1.530s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-5c65bf35-3c1a-400f-b560-2ae419ecbbc7 req-de7b48ca-712d-43a5-9ab6-3ce3b3f6d06c tempest-TestMinimumBasicScenario-1044707550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.582s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:09 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Flow 'volume_create_manager' (5130583e-0812-4951-a363-51a3f5ad52ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e941982-1aca-49a5-a513-ccf87c90fd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e941982-1aca-49a5-a513-ccf87c90fd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1019821003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3cf384-5128-4902-a8ca-839db42bdc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23d266accd84b42b2caf540c11f8e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:46:09Z,use_quota=True,user_id='6345a7280ae64336869ff0e1c8a79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4626c1af-06bd-4a66-afac-6ef59a4aa896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4626c1af-06bd-4a66-afac-6ef59a4aa896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843aa167-86f3-4dee-9b48-23b33d9b8210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (843aa167-86f3-4dee-9b48-23b33d9b8210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d3cf384-5128-4902-a8ca-839db42bdc3e', 'volume_name': 'volume-7d3cf384-5128-4902-a8ca-839db42bdc3e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837f700b-e9eb-4a00-8fcb-0266d7741201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837f700b-e9eb-4a00-8fcb-0266d7741201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc941d6f-cd7b-4b56-8977-720e40375206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:10 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Volume 7d3cf384-5128-4902-a8ca-839db42bdc3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d3cf384-5128-4902-a8ca-839db42bdc3e', 'volume_size': 1} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1019821003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d3cf384-5128-4902-a8ca-839db42bdc3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d23d266accd84b42b2caf540c11f8e0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:46:09Z,use_quota=True,user_id='6345a7280ae64336869ff0e1c8a79464',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Creating volume 7d3cf384-5128-4902-a8ca-839db42bdc3e {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:46:10 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:10 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=85, name=volume-7d3cf384-5128-4902-a8ca-839db42bdc3e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:46:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-5c65bf35-3c1a-400f-b560-2ae419ecbbc7 req-de7b48ca-712d-43a5-9ab6-3ce3b3f6d06c tempest-TestMinimumBasicScenario-1044707550 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-02718319-58ad-4379-be4c-f04bdb866f13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '15b132c2-07c5-45ad-95d6-cfde260c2aca', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:46:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-5c65bf35-3c1a-400f-b560-2ae419ecbbc7 req-de7b48ca-712d-43a5-9ab6-3ce3b3f6d06c tempest-TestMinimumBasicScenario-1044707550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 2.473s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:11 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:46:11 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Deleted volume successfully. Sep 16 01:46:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e 1073741824" returned: 0 in 1.174s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e" returned: 0 in 0.608s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] <== create_volume: return (1841ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:46:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9b4511ba-6940-49e6-9543-9684378b5919 tempest-VolumesSnapshotListTestJSON-1101085925 None] Lock "cinder-db2341fa-c99d-430f-b07b-2252dcec6bde-delete_volume" released by "delete_volume" :: held 7.610s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-5c65bf35-3c1a-400f-b560-2ae419ecbbc7 req-de7b48ca-712d-43a5-9ab6-3ce3b3f6d06c tempest-TestMinimumBasicScenario-1044707550 None] attachment_update completed successfully. Sep 16 01:46:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc941d6f-cd7b-4b56-8977-720e40375206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d3cf384-5128-4902-a8ca-839db42bdc3e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e62de0a-e347-4cfa-8b78-2e6c9cfc9718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:12 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Volume volume-7d3cf384-5128-4902-a8ca-839db42bdc3e (7d3cf384-5128-4902-a8ca-839db42bdc3e): created successfully Sep 16 01:46:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e62de0a-e347-4cfa-8b78-2e6c9cfc9718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Flow 'volume_create_manager' (5130583e-0812-4951-a363-51a3f5ad52ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:46:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-7fc825c5-c4b5-43eb-b916-a6a31a361417 tempest-AttachVolumeNegativeTest-678661232 None] Created volume successfully. Sep 16 01:46:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Flow 'volume_create_manager' (6730fdbb-5cf3-45c7-947d-08a06af7e9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c944d0a-3c05-40c1-833c-63a27339cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c944d0a-3c05-40c1-833c-63a27339cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1245336807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66fa405c-bddc-4291-9f0f-b46c5d0b7632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa7db7582fea4f34be82c0d19703a51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:46:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:46:16Z,use_quota=True,user_id='9b9eed4d52864e94b7b116636c574259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def898d5-f43f-4b19-b43f-302185786ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (def898d5-f43f-4b19-b43f-302185786ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a314298b-b40a-41ed-8497-58e8d672eb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a314298b-b40a-41ed-8497-58e8d672eb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66fa405c-bddc-4291-9f0f-b46c5d0b7632', 'volume_name': 'volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632', 'volume_size': 2}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d3b2aa-67f2-47c4-ac53-77634f620c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d3b2aa-67f2-47c4-ac53-77634f620c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dfb8e6-78f0-4666-8797-5fab33df562e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:15 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Volume 66fa405c-bddc-4291-9f0f-b46c5d0b7632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632', 'volume_size': 2} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1245336807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66fa405c-bddc-4291-9f0f-b46c5d0b7632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa7db7582fea4f34be82c0d19703a51e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:46:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:46:16Z,use_quota=True,user_id='9b9eed4d52864e94b7b116636c574259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Creating volume 66fa405c-bddc-4291-9f0f-b46c5d0b7632 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:46:15 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:46:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 2147483648 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:16 devstack quobyte-client[83066]: System call of process 94064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:46:16 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=86, name=volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:46:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 2147483648" returned: 0 in 0.620s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632" returned: 0 in 0.130s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] <== create_volume: return (886ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:46:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dfb8e6-78f0-4666-8797-5fab33df562e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632', 'volume_size': 2}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e602d489-0bb3-4a2e-9946-c1248330cf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:46:17 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Volume volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 (66fa405c-bddc-4291-9f0f-b46c5d0b7632): created successfully Sep 16 01:46:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e602d489-0bb3-4a2e-9946-c1248330cf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:46:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Flow 'volume_create_manager' (6730fdbb-5cf3-45c7-947d-08a06af7e9b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:46:17 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-c1de721f-8c97-4b6c-acc2-378451e76e52 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Created volume successfully. Sep 16 01:46:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-75d0328b-7c76-462a-9349-699bee27d4b0 req-8a61f639-1a2e-4ab2-a679-605c0dd53f68 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-75d0328b-7c76-462a-9349-699bee27d4b0 req-8a61f639-1a2e-4ab2-a679-605c0dd53f68 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:18 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:18 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a958a28b-b760-49ba-8e77-3fd2ec8b15a2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-75d0328b-7c76-462a-9349-699bee27d4b0 req-8a61f639-1a2e-4ab2-a679-605c0dd53f68 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-75d0328b-7c76-462a-9349-699bee27d4b0 req-8a61f639-1a2e-4ab2-a679-605c0dd53f68 tempest-AttachVolumeNegativeTest-678661232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e" returned: 0 in 0.541s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-75d0328b-7c76-462a-9349-699bee27d4b0 req-8a61f639-1a2e-4ab2-a679-605c0dd53f68 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.643s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.798s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Creating offline snapshot 86260f35-620e-4e93-883a-4dbe51486240 of volume 66fa405c-bddc-4291-9f0f-b46c5d0b7632 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:46:19 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[faab8464-69ad-4d69-8d0e-8ce1b5810ae2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-75d0328b-7c76-462a-9349-699bee27d4b0 req-8a61f639-1a2e-4ab2-a679-605c0dd53f68 tempest-AttachVolumeNegativeTest-678661232 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-7d3cf384-5128-4902-a8ca-839db42bdc3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee0b42da-6f03-42bb-8cfd-78e224c8711c', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:46:19 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-75d0328b-7c76-462a-9349-699bee27d4b0 req-8a61f639-1a2e-4ab2-a679-605c0dd53f68 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:20 devstack quobyte-client[83066]: System call of process 94079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:46:20 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-75d0328b-7c76-462a-9349-699bee27d4b0 req-8a61f639-1a2e-4ab2-a679-605c0dd53f68 tempest-AttachVolumeNegativeTest-678661232 None] attachment_update completed successfully. Sep 16 01:46:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632" returned: 0 in 1.007s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 2G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:20 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=87, name=volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:46:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 2G" returned: 0 in 0.409s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): qemu-img rebase -u -b volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "qemu-img rebase -u -b volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240" returned: 0 in 0.335s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:46:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240" returned: 0 in 0.128s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:46:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240" returned: 0 in 0.225s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.info" returned: 0 in 0.261s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:46:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.info" returned: 0 in 0.239s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.332s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:23 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-86546b6b-ebdf-4cbb-9441-6766195447ef tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Create snapshot completed successfully Sep 16 01:46:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "cinder-86260f35-620e-4e93-883a-4dbe51486240-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-86260f35-620e-4e93-883a-4dbe51486240-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "cinder-quobyte-66fa405c-bddc-4291-9f0f-b46c5d0b7632" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-quobyte-66fa405c-bddc-4291-9f0f-b46c5d0b7632" acquired by "delete_snapshot" :: waited 0.017s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "cinder-quobyte-86260f35-620e-4e93-883a-4dbe51486240" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-quobyte-86260f35-620e-4e93-883a-4dbe51486240" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Deleting offline snapshot 86260f35-620e-4e93-883a-4dbe51486240 of volume 66fa405c-bddc-4291-9f0f-b46c5d0b7632 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] snapshot_file for this snap is: volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef16d0f-3ff2-478a-b592-417a5825ec0f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:25 devstack quobyte-client[83066]: System call of process 94098 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:46:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240" returned: 0 in 1.000s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:46:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[103fbfe3-e32c-4bc8-ae48-1cea3dd098db]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632" returned: 0 in 1.088s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240" returned: 0 in 0.603s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632.86260f35-620e-4e93-883a-4dbe51486240" returned: 0 in 0.170s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-quobyte-86260f35-620e-4e93-883a-4dbe51486240" released by "_delete_snapshot" :: held 3.606s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-quobyte-66fa405c-bddc-4291-9f0f-b46c5d0b7632" released by "delete_snapshot" :: held 3.653s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:28 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=41,cinder:SELECT=48,cinder:INSERT=7,cinder:DELETE=4 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:46:28 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=44,cinder:INSERT=13,cinder:UPDATE=55,cinder:DELETE=6 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:46:28 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Created reservations ['1f8e5f4f-fe76-4832-851d-cde55f0d2d8a', 'c6b63e83-4ec7-4a59-a63b-7548767a572a', 'cc820e61-7307-4655-b430-819a9eaadcb6', 'd4ebac67-e103-490f-932e-bd61bb0f8060'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:46:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Delete snapshot completed successfully. Sep 16 01:46:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08ba4966-6e09-4115-8cf5-adaa11657921 tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-86260f35-620e-4e93-883a-4dbe51486240-delete_snapshot" released by "delete_snapshot" :: held 4.707s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "cinder-66fa405c-bddc-4291-9f0f-b46c5d0b7632-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-66fa405c-bddc-4291-9f0f-b46c5d0b7632-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:30 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "cinder-quobyte-66fa405c-bddc-4291-9f0f-b46c5d0b7632" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:46:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-quobyte-66fa405c-bddc-4291-9f0f-b46c5d0b7632" acquired by "delete_volume" :: waited 0.019s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:46:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[887289cc-d1fe-4d6a-9d10-e401302f31ff]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:46:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632" returned: 0 in 0.855s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-66fa405c-bddc-4291-9f0f-b46c5d0b7632" returned: 0 in 0.248s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-quobyte-66fa405c-bddc-4291-9f0f-b46c5d0b7632" released by "delete_volume" :: held 1.362s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:31 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Created reservations ['0884ccd1-2f6c-45ca-aa80-a0a23abe217a', 'ca18d104-8f93-4a36-80ae-ad89fdc3ecfb', '5963a619-0cad-47dd-80e3-f9d1813ac49d', '1b51d7bf-f12d-4fbe-8f08-e9d9f6fae5e5'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:46:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:46:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:46:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:46:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:46:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:46:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:46:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.176s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:46:32 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:46:32 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Deleted volume successfully. Sep 16 01:46:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a469d0b8-e8a7-4c70-aef0-fd0ac4310d5a tempest-VolumesSnapshotNegativeTestJSON-134940501 None] Lock "cinder-66fa405c-bddc-4291-9f0f-b46c5d0b7632-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:46:42 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=15,cinder:SELECT=3,cinder:INSERT=4 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:46:42 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=14,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:46:50 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-5c0df177-5c26-4132-affa-bddf6ad63907 req-789c79d2-f6ee-466c-a227-97d55ab1fb9f tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:50 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-5c0df177-5c26-4132-affa-bddf6ad63907 req-789c79d2-f6ee-466c-a227-97d55ab1fb9f tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:46:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-5c0df177-5c26-4132-affa-bddf6ad63907 req-789c79d2-f6ee-466c-a227-97d55ab1fb9f tempest-AttachVolumeNegativeTest-678661232 None] Terminate volume connection completed successfully. Sep 16 01:46:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-5c0df177-5c26-4132-affa-bddf6ad63907 req-789c79d2-f6ee-466c-a227-97d55ab1fb9f tempest-AttachVolumeNegativeTest-678661232 None] Deleting attachment ee0b42da-6f03-42bb-8cfd-78e224c8711c. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:47:00 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:47:04 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Flow 'volume_create_manager' (139d7194-0bca-439f-a10c-965916fcc74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57300846-0fb0-4abe-9a83-66d83846b9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57300846-0fb0-4abe-9a83-66d83846b9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2056281155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4eca535-bf24-4e11-9c51-437be649a322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1691e25263554fb7bec5b72086590719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:47:04Z,use_quota=True,user_id='13420a6b6dbe4d03a2eac2b9f80301e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b824dc55-2573-4ee6-b283-c5e9870c12ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b824dc55-2573-4ee6-b283-c5e9870c12ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d2d78f-dcbd-4a6a-8d72-12d75306ea9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d2d78f-dcbd-4a6a-8d72-12d75306ea9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4eca535-bf24-4e11-9c51-437be649a322', 'volume_name': 'volume-b4eca535-bf24-4e11-9c51-437be649a322', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13a5be7-315e-423a-bcd0-bac9d99f52d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13a5be7-315e-423a-bcd0-bac9d99f52d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f6d28a-8fa0-41e2-9d03-a41bc12841dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:04 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume b4eca535-bf24-4e11-9c51-437be649a322: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4eca535-bf24-4e11-9c51-437be649a322', 'volume_size': 1} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2056281155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4eca535-bf24-4e11-9c51-437be649a322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1691e25263554fb7bec5b72086590719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:47:04Z,use_quota=True,user_id='13420a6b6dbe4d03a2eac2b9f80301e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Creating volume b4eca535-bf24-4e11-9c51-437be649a322 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:47:04 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:04 devstack quobyte-client[83066]: System call of process 94284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:47:04 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=89, name=volume-b4eca535-bf24-4e11-9c51-437be649a322, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:47:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:47:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:47:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:47:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322 1073741824" returned: 0 in 1.595s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 1.193s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:06 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:47:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:47:06 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:47:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Flow 'volume_create_manager' (d2477511-ee61-4901-b889-549523dc7e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:47:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a90da2-5e3d-4e5d-be8a-1899b8228680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322" returned: 0 in 0.892s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a90da2-5e3d-4e5d-be8a-1899b8228680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-266149590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f88ce8-882e-464b-8a45-8c73e3f805a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1691e25263554fb7bec5b72086590719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:47:05Z,use_quota=True,user_id='13420a6b6dbe4d03a2eac2b9f80301e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b1ab01-e39e-4b22-9721-c8ed5f74ce20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b1ab01-e39e-4b22-9721-c8ed5f74ce20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c9c112-515a-420c-8fbe-88640f2c19f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4c9c112-515a-420c-8fbe-88640f2c19f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80f88ce8-882e-464b-8a45-8c73e3f805a3', 'volume_name': 'volume-80f88ce8-882e-464b-8a45-8c73e3f805a3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d7a509-023c-401a-9d02-2c18e7fd55d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d7a509-023c-401a-9d02-2c18e7fd55d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005acf35-2613-4e68-9481-a220ee46d5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:07 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume 80f88ce8-882e-464b-8a45-8c73e3f805a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80f88ce8-882e-464b-8a45-8c73e3f805a3', 'volume_size': 1} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] <== create_volume: return (2643ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.650s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-266149590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80f88ce8-882e-464b-8a45-8c73e3f805a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1691e25263554fb7bec5b72086590719',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:47:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:47:05Z,use_quota=True,user_id='13420a6b6dbe4d03a2eac2b9f80301e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Creating volume 80f88ce8-882e-464b-8a45-8c73e3f805a3 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:47:07 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:47:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:07 devstack quobyte-client[83066]: System call of process 94293 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:47:07 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=90, name=volume-80f88ce8-882e-464b-8a45-8c73e3f805a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:47:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f6d28a-8fa0-41e2-9d03-a41bc12841dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4eca535-bf24-4e11-9c51-437be649a322', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3036cb91-01c1-4fe9-a842-f6dae1ff50a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3 1073741824" returned: 0 in 1.210s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:08 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume volume-b4eca535-bf24-4e11-9c51-437be649a322 (b4eca535-bf24-4e11-9c51-437be649a322): created successfully Sep 16 01:47:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3036cb91-01c1-4fe9-a842-f6dae1ff50a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Flow 'volume_create_manager' (139d7194-0bca-439f-a10c-965916fcc74c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:47:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-cfdecdb2-743c-4967-848d-c3cf13c701f5 tempest-TestServerVolumeAttachmentScenario-552909398 None] Created volume successfully. Sep 16 01:47:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3" returned: 0 in 0.818s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] <== create_volume: return (2075ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:47:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.084s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005acf35-2613-4e68-9481-a220ee46d5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80f88ce8-882e-464b-8a45-8c73e3f805a3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3050b3-8b79-4d77-af55-7888562b0810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:09 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume volume-80f88ce8-882e-464b-8a45-8c73e3f805a3 (80f88ce8-882e-464b-8a45-8c73e3f805a3): created successfully Sep 16 01:47:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e3050b3-8b79-4d77-af55-7888562b0810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Flow 'volume_create_manager' (d2477511-ee61-4901-b889-549523dc7e93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:47:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4774e5c1-9435-4d85-a1d4-6c53209f2ee4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Created volume successfully. Sep 16 01:47:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "cinder-7d3cf384-5128-4902-a8ca-839db42bdc3e-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:47:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-7d3cf384-5128-4902-a8ca-839db42bdc3e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:47:13 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:47:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "cinder-quobyte-7d3cf384-5128-4902-a8ca-839db42bdc3e" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:47:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-quobyte-7d3cf384-5128-4902-a8ca-839db42bdc3e" acquired by "delete_volume" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:47:13 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca0924c-01f8-451c-909e-162d9a161843]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:47:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e" returned: 0 in 0.523s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-7d3cf384-5128-4902-a8ca-839db42bdc3e" returned: 0 in 0.133s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-quobyte-7d3cf384-5128-4902-a8ca-839db42bdc3e" released by "delete_volume" :: held 0.818s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Created reservations ['96439002-53a0-46cc-a6e9-9870d4752e40', 'ff71f6ab-f5c5-435a-9481-97465f9a8d6a', 'c2c0aeed-1ec6-47a0-ba93-9f483e23c3db', '2168695d-40a9-4d51-9c70-15f7e867679f'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.105s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:14 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:47:14 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Deleted volume successfully. Sep 16 01:47:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-25f3b74a-7122-4af9-8aed-6f214991d711 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-7d3cf384-5128-4902-a8ca-839db42bdc3e-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:47:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "cinder-46a62d62-bcd4-492e-ac58-422d64a7073a-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:47:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-46a62d62-bcd4-492e-ac58-422d64a7073a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:47:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:47:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "cinder-quobyte-46a62d62-bcd4-492e-ac58-422d64a7073a" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:47:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-quobyte-46a62d62-bcd4-492e-ac58-422d64a7073a" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:47:15 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3eedbaa-121a-4093-a788-d6f90d8f42e6]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:47:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:17 devstack quobyte-client[83066]: System call of process 94312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:47:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a" returned: 0 in 1.301s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46a62d62-bcd4-492e-ac58-422d64a7073a" returned: 0 in 0.230s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-quobyte-46a62d62-bcd4-492e-ac58-422d64a7073a" released by "delete_volume" :: held 1.940s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:47:18 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Created reservations ['3ec3886c-1eeb-4dea-ae1e-63439571942c', 'f20852d0-94ea-4394-963d-5144180e1446', '9a735fcc-d818-4e60-9241-8d1cf6ce90e2', '536e4093-b28d-43b1-999c-8b60c7cadec7'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:47:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:47:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:47:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.279s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:19 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:47:19 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Deleted volume successfully. Sep 16 01:47:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "cinder-b39c1a3b-d521-429d-b91c-19e89788a5ae-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:47:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-56aa2511-d4f7-4a74-8b6c-6c7026108572 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-46a62d62-bcd4-492e-ac58-422d64a7073a-delete_volume" released by "delete_volume" :: held 5.258s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:47:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-b39c1a3b-d521-429d-b91c-19e89788a5ae-delete_volume" acquired by "delete_volume" :: waited 0.214s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:47:21 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:47:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "cinder-quobyte-b39c1a3b-d521-429d-b91c-19e89788a5ae" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:47:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-quobyte-b39c1a3b-d521-429d-b91c-19e89788a5ae" acquired by "delete_volume" :: waited 0.062s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:47:21 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[90702251-b9d2-48cd-a6e9-d563e8e6063b]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:47:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae" returned: 0 in 2.060s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b39c1a3b-d521-429d-b91c-19e89788a5ae" returned: 0 in 0.385s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-quobyte-b39c1a3b-d521-429d-b91c-19e89788a5ae" released by "delete_volume" :: held 3.045s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:47:25 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Created reservations ['f8239587-7559-42ca-8176-a56b383935be', 'f45da77e-4d22-4e08-b388-1debf0faaab0', '1b0d7b11-cfa7-42b6-8e55-5f6c761a0465', '172a0481-0902-4801-a997-ddca70c18065'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:47:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:47:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:47:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.368s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:26 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:47:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Deleted volume successfully. Sep 16 01:47:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-50797c73-e4d2-4652-aa40-0b9b5c84d1c3 tempest-AttachVolumeNegativeTest-678661232 None] Lock "cinder-b39c1a3b-d521-429d-b91c-19e89788a5ae-delete_volume" released by "delete_volume" :: held 6.997s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:47:36 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=18,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=10 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:47:37 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=16,cinder:UPDATE=28,cinder:DELETE=3,cinder:INSERT=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:47:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Flow 'volume_create_manager' (c9fcabff-91ff-4dc9-91e4-355e1c686ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23153393-c0bb-42ab-8f07-05566fc6a93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23153393-c0bb-42ab-8f07-05566fc6a93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1311022974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47eb95e45e2b4730b3b86518d6db59aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:47:47Z,use_quota=True,user_id='400effd0fbd540ca88fd1c3bd68483a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543d13b0-dc9b-4000-8859-338d4457150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (543d13b0-dc9b-4000-8859-338d4457150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26a5c2d-a922-4371-a21a-405ca807db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a26a5c2d-a922-4371-a21a-405ca807db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc', 'volume_name': 'volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1a4cfb-2fc8-4f71-899b-c1553eff6fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da1a4cfb-2fc8-4f71-899b-c1553eff6fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b6c9c2-c4e3-4045-9258-918de540f580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:47 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Volume 2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc', 'volume_size': 1} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:47:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1311022974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='47eb95e45e2b4730b3b86518d6db59aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:47:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:47:47Z,use_quota=True,user_id='400effd0fbd540ca88fd1c3bd68483a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Creating volume 2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:47:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:47:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:47:48 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:47:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:48 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=91, name=volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:47:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc 1073741824" returned: 0 in 1.351s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc" returned: 0 in 0.433s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] <== create_volume: return (2039ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:47:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.096s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b6c9c2-c4e3-4045-9258-918de540f580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc02c897-37ed-4e6b-8a4a-3b1b1393fab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:47:50 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Volume volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc (2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc): created successfully Sep 16 01:47:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc02c897-37ed-4e6b-8a4a-3b1b1393fab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:47:50 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Flow 'volume_create_manager' (c9fcabff-91ff-4dc9-91e4-355e1c686ade) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:47:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-e291f24a-3249-48e7-9de2-1ebcb8cccde3 req-30375b1d-abc9-4720-9a43-1411ca839eb8 tempest-VolumesGetTestJSON-899304415 None] Created volume successfully. Sep 16 01:47:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Acquiring lock "cinder-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:47:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Lock "cinder-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:47:52 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:47:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Acquiring lock "cinder-quobyte-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:47:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Lock "cinder-quobyte-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc" acquired by "delete_volume" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:47:52 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8850d76-74b8-485b-9d71-564b8926a757]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:47:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:53 devstack quobyte-client[83066]: System call of process 94593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:47:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc" returned: 0 in 0.865s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc" returned: 0 in 0.298s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Lock "cinder-quobyte-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc" released by "delete_volume" :: held 1.476s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG cinder.quota [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Created reservations ['7f6ea574-91ad-4bb2-8af8-ee2bf11012df', 'd82f56a5-d66e-4640-a477-61a9d02f3436', '96afd88f-1539-41d4-a7b3-48ac1c188d33', 'e24726e0-bb02-4137-98c9-45718856c1c5'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.150s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG cinder.manager [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:47:54 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Deleted volume successfully. Sep 16 01:47:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-e36ac2a8-555a-4639-8718-48bd32da8e98 req-9dab5644-e318-49db-9872-32faebcc2165 tempest-VolumesGetTestJSON-899304415 None] Lock "cinder-2eb16a81-3542-42eb-81cb-f1ebeb8cd0bc-delete_volume" released by "delete_volume" :: held 2.941s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:48:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:48:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:48:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.213s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:48:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6b47f47d-c834-4410-8f98-bf91ff3ccf32 tempest-GroupsV320Test-1601902146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6b47f47d-c834-4410-8f98-bf91ff3ccf32 tempest-GroupsV320Test-1601902146 None] Group tempest-GroupsV320Test-Group-560790667: creating Sep 16 01:48:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6b47f47d-c834-4410-8f98-bf91ff3ccf32 tempest-GroupsV320Test-1601902146 None] Group tempest-GroupsV320Test-Group-560790667: created successfully Sep 16 01:48:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6b47f47d-c834-4410-8f98-bf91ff3ccf32 tempest-GroupsV320Test-1601902146 None] Create group completed successfully. Sep 16 01:48:14 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Created reservations ['594cec5c-9932-43e7-a898-d4b390b5e660'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.127s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:14 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:48:14 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-226be5eb-e41f-4970-a5f9-d7652f201ba2 tempest-GroupsV320Test-1601902146 None] Delete group completed successfully. Sep 16 01:48:21 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Flow 'volume_create_manager' (817eddab-12f0-4d5e-a0f4-246de6c99038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7febbfe-6b4b-4f95-b1e5-a4475c0e15bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7febbfe-6b4b-4f95-b1e5-a4475c0e15bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-834218586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c770b3da-6789-4d7a-a1a5-e31dddd230ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7146f9d64b4d4703a35130d5913618fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:48:21Z,use_quota=True,user_id='03a2052a30f54ca5bfee15f9c856a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019b095d-5692-4c1b-8ed6-d9d8962e8e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (019b095d-5692-4c1b-8ed6-d9d8962e8e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1fc4c7-6965-4e29-99fc-90f222ac098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad1fc4c7-6965-4e29-99fc-90f222ac098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c770b3da-6789-4d7a-a1a5-e31dddd230ba', 'volume_name': 'volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d363662-1c1c-42a6-a3ce-89e423f4c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d363662-1c1c-42a6-a3ce-89e423f4c580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0259f09-f396-4858-b46d-087393606196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:48:21 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Volume c770b3da-6789-4d7a-a1a5-e31dddd230ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba', 'volume_size': 1} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-834218586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c770b3da-6789-4d7a-a1a5-e31dddd230ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7146f9d64b4d4703a35130d5913618fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:48:21Z,use_quota=True,user_id='03a2052a30f54ca5bfee15f9c856a625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Creating volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:48:21 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:48:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:21 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=92, name=volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba 1073741824" returned: 0 in 0.424s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba" returned: 0 in 0.182s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] <== create_volume: return (714ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0259f09-f396-4858-b46d-087393606196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51685bab-e7fb-4139-9e77-5f46a59cba42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:48:22 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Volume volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba (c770b3da-6789-4d7a-a1a5-e31dddd230ba): created successfully Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51685bab-e7fb-4139-9e77-5f46a59cba42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:48:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Flow 'volume_create_manager' (817eddab-12f0-4d5e-a0f4-246de6c99038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:48:22 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-506de4e2-cb9f-42fe-a3c7-615a6c734ca1 tempest-SnapshotsActionsTest-1025636570 None] Created volume successfully. Sep 16 01:48:23 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Creating offline snapshot 00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:48:23 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[50435778-b6f2-4f3a-a85f-d7c30482e42c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba" returned: 0 in 0.469s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:24 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=93, name=volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:48:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 1G" returned: 0 in 0.230s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.156s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:48:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.115s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.119s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.info" returned: 0 in 0.143s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.info" returned: 0 in 0.090s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.693s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:25 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-adc1f96d-9517-4509-9d4e-f330a0c99c51 tempest-SnapshotsActionsTest-1025636570 None] Create snapshot completed successfully Sep 16 01:48:27 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Creating offline snapshot de59195a-df67-41c8-8b54-b3bd378d3f58 of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:48:27 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2d3dc2-182a-49a4-9de0-9af60075be52]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:27 devstack quobyte-client[83066]: System call of process 94670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.422s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:28 devstack quobyte-client[83066]: System call of process 94673 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:28 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=95, name=volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 1G" returned: 0 in 0.291s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58" returned: 0 in 0.167s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58" returned: 0 in 0.085s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58" returned: 0 in 0.090s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.366s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:29 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-69ce2e5d-ee84-4332-9e8c-c6602ad77e42 tempest-SnapshotsActionsTest-1025636570 None] Create snapshot completed successfully Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-de59195a-df67-41c8-8b54-b3bd378d3f58-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-de59195a-df67-41c8-8b54-b3bd378d3f58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:29 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-quobyte-de59195a-df67-41c8-8b54-b3bd378d3f58" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-de59195a-df67-41c8-8b54-b3bd378d3f58" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Deleting offline snapshot de59195a-df67-41c8-8b54-b3bd378d3f58 of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] snapshot_file for this snap is: volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[be32c29e-466f-4795-85f7-8823e65ed79a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:30 devstack quobyte-client[83066]: System call of process 94687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58" returned: 0 in 0.500s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d2d29c-9f11-4469-ae21-b164ae2e0ace]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.412s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:31 devstack quobyte-client[83066]: System call of process 94693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58" returned: 0 in 0.372s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.de59195a-df67-41c8-8b54-b3bd378d3f58" returned: 0 in 0.151s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-de59195a-df67-41c8-8b54-b3bd378d3f58" released by "_delete_snapshot" :: held 1.926s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" released by "delete_snapshot" :: held 1.963s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:32 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Created reservations ['80e02306-6aa4-4d16-bf6e-1341b5ca2b2d', 'e11c0b0c-3234-4671-b8bb-8c0b35a1bdca', 'f1cfb370-acb7-448b-a2cd-51d8f28473e3', '259380d8-e32a-45c2-a7f1-a8d1b75c5f13'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:48:32 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Delete snapshot completed successfully. Sep 16 01:48:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8d9190c9-4744-4994-bfc7-d7ad563607b2 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-de59195a-df67-41c8-8b54-b3bd378d3f58-delete_snapshot" released by "delete_snapshot" :: held 2.874s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:33 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Creating offline snapshot 5581117e-6976-4b8d-b966-15f9c99d5960 of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:48:33 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b951c7c3-7f92-4de6-8d37-bcbfd2df4291]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:34 devstack quobyte-client[83066]: System call of process 94734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.682s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:34 devstack quobyte-client[83066]: System call of process 94738 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:35 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=96, name=volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:48:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 1G" returned: 0 in 0.550s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:35 devstack quobyte-client[83066]: System call of process 94743 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960" returned: 0 in 0.332s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:48:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960" returned: 0 in 0.271s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:48:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960" returned: 0 in 0.373s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.058s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:37 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-9ae04247-9e84-42be-b4fe-24afbcf5c774 tempest-SnapshotsActionsTest-1025636570 None] Create snapshot completed successfully Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-5581117e-6976-4b8d-b966-15f9c99d5960-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-5581117e-6976-4b8d-b966-15f9c99d5960-delete_snapshot" acquired by "delete_snapshot" :: waited 0.172s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:38 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-quobyte-5581117e-6976-4b8d-b966-15f9c99d5960" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-5581117e-6976-4b8d-b966-15f9c99d5960" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Deleting offline snapshot 5581117e-6976-4b8d-b966-15f9c99d5960 of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] snapshot_file for this snap is: volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a081faa0-c653-43c7-b3e5-ea1f165838ab]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960" returned: 0 in 1.080s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:40 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1628db9-4bec-4016-9dd0-3f360a55cf71]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:41 devstack quobyte-client[83066]: System call of process 94772 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 1.558s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:42 devstack quobyte-client[83066]: System call of process 94782 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960" returned: 0 in 0.540s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5581117e-6976-4b8d-b966-15f9c99d5960" returned: 0 in 0.280s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-5581117e-6976-4b8d-b966-15f9c99d5960" released by "_delete_snapshot" :: held 4.211s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" released by "delete_snapshot" :: held 4.294s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:43 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=22,cinder:UPDATE=29,cinder:DELETE=5,cinder:INSERT=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:48:43 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Created reservations ['107e269c-8826-4b5d-9a56-3cb68ed3b733', '1f95e380-27f6-44b5-ad63-6fc98ea36a2f', 'ff3a4cda-c168-4da8-971a-5a3ed465c9d5', 'f56222f9-0df3-4a39-99c1-24022fe38eea'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:48:43 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Delete snapshot completed successfully. Sep 16 01:48:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-21335097-1bc5-426c-899e-3e9164efc966 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-5581117e-6976-4b8d-b966-15f9c99d5960-delete_snapshot" released by "delete_snapshot" :: held 4.921s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Creating offline snapshot f327b540-b05f-4975-aa5f-ef60948d37fb of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:48:44 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2fc37d-380c-4f88-888e-0fb76118c2c2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.992s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:46 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=97, name=volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb 1G" returned: 0 in 0.315s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb" returned: 0 in 0.150s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb" returned: 0 in 0.092s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb" returned: 0 in 0.137s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:47 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=23,cinder:SELECT=32,cinder:INSERT=10,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:48:47 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-301c04e9-4586-4516-ba4e-7a858c8940c3 tempest-SnapshotsActionsTest-1025636570 None] Create snapshot completed successfully Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-f327b540-b05f-4975-aa5f-ef60948d37fb-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-f327b540-b05f-4975-aa5f-ef60948d37fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:48 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" acquired by "delete_snapshot" :: waited 0.043s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-quobyte-f327b540-b05f-4975-aa5f-ef60948d37fb" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-f327b540-b05f-4975-aa5f-ef60948d37fb" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Deleting offline snapshot f327b540-b05f-4975-aa5f-ef60948d37fb of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] snapshot_file for this snap is: volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a076f0-ba7a-4eca-be66-490f3a5d5136]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:48 devstack quobyte-client[83066]: System call of process 94805 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb" returned: 0 in 0.388s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9485fb5-2ec0-42cf-b06e-79056499130c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.429s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb" returned: 0 in 0.227s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.f327b540-b05f-4975-aa5f-ef60948d37fb" returned: 0 in 0.089s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-f327b540-b05f-4975-aa5f-ef60948d37fb" released by "_delete_snapshot" :: held 1.430s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" released by "delete_snapshot" :: held 1.456s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:49 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Created reservations ['d64ad1d9-41cd-49dd-a47c-461a700a0aee', 'abbf11d1-de9a-48b5-9985-dea9c36744f3', '69328c1a-edee-4d93-a2fe-d0a3a12121a8', '3871b6b1-6b73-4b03-9909-6b618909da03'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:48:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Delete snapshot completed successfully. Sep 16 01:48:50 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d00802f5-0d9e-46aa-9dac-2bcf2b606ff0 tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-f327b540-b05f-4975-aa5f-ef60948d37fb-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:50 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Creating offline snapshot 5fd61c9f-11c7-42e1-94da-8c4f14320dc0 of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:48:50 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1868dd-8a37-4cea-ae8e-33a56720b0a5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.431s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:51 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=98, name=volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 1G" returned: 0 in 0.247s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img rebase -u -b volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0" returned: 0 in 0.143s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0" returned: 0 in 0.094s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0" returned: 0 in 0.115s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.302s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:52 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3595c8c4-c993-4d46-848c-8aa22c9023ae tempest-SnapshotsActionsTest-1025636570 None] Create snapshot completed successfully Sep 16 01:48:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-5fd61c9f-11c7-42e1-94da-8c4f14320dc0-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-5fd61c9f-11c7-42e1-94da-8c4f14320dc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:52 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Acquiring lock "cinder-quobyte-5fd61c9f-11c7-42e1-94da-8c4f14320dc0" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-5fd61c9f-11c7-42e1-94da-8c4f14320dc0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Deleting offline snapshot 5fd61c9f-11c7-42e1-94da-8c4f14320dc0 of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:48:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] snapshot_file for this snap is: volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:48:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ce6349-0517-415c-92ba-01c5be38c64f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0" returned: 0 in 0.585s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[94916658-9aed-45f0-96b3-02277ed1014a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.593s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0" returned: 0 in 0.216s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.5fd61c9f-11c7-42e1-94da-8c4f14320dc0" returned: 0 in 0.098s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-5fd61c9f-11c7-42e1-94da-8c4f14320dc0" released by "_delete_snapshot" :: held 1.860s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" released by "delete_snapshot" :: held 1.889s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:55 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Created reservations ['c1f3d45d-cc64-4b49-8341-b1eb491da2ef', '5b38e222-a1a3-4faa-8587-402e04896093', '39e7c59e-5807-472a-a851-fc7719d25e72', '8839dfd9-c69a-4ef4-98d9-59bf8c1a8848'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:48:55 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Delete snapshot completed successfully. Sep 16 01:48:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-84bc1738-f62b-4aa7-9a8c-375f625136ce tempest-SnapshotsActionsTest-1691665624 None] Lock "cinder-5fd61c9f-11c7-42e1-94da-8c4f14320dc0-delete_snapshot" released by "delete_snapshot" :: held 2.383s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "cinder-00b72b2c-849a-45ad-9a0a-7fdcf7b9b292-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-00b72b2c-849a-45ad-9a0a-7fdcf7b9b292-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:56 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" acquired by "delete_snapshot" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "cinder-quobyte-00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-quobyte-00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Deleting offline snapshot 00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 of volume c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] snapshot_file for this snap is: volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[91925f0a-c227-44e5-b75f-ac880fa95d37]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:57 devstack quobyte-client[83066]: System call of process 94841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:48:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.594s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:48:57 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[20473c4b-2b1f-4dc2-b841-6825c585144f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba" returned: 0 in 0.696s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-4bb83790-22cf-484a-a107-a07d2563647a req-2e1f468a-80c6-499f-a559-e54553ef330c tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:48:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-4bb83790-22cf-484a-a107-a07d2563647a req-2e1f468a-80c6-499f-a559-e54553ef330c tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:48:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.564s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d353ae33-bcb0-45c5-902d-6969c23392c9]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-4bb83790-22cf-484a-a107-a07d2563647a req-2e1f468a-80c6-499f-a559-e54553ef330c tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba.00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" returned: 0 in 0.333s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-quobyte-00b72b2c-849a-45ad-9a0a-7fdcf7b9b292" released by "_delete_snapshot" :: held 2.532s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" released by "delete_snapshot" :: held 2.558s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Created reservations ['3382b21e-ea81-4350-b9db-098c0aa709fe', 'ce3e71b0-715d-4c76-8b74-ca70ac80e5a7', 'f2e3eecb-4f99-4604-8355-fea8664ed78f', '7444246a-e571-478f-9ed6-5eff6420ae6c'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-4bb83790-22cf-484a-a107-a07d2563647a req-2e1f468a-80c6-499f-a559-e54553ef330c tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322" returned: 0 in 0.735s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-4bb83790-22cf-484a-a107-a07d2563647a req-2e1f468a-80c6-499f-a559-e54553ef330c tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.993s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:48:59 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Delete snapshot completed successfully. Sep 16 01:48:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3a14bdac-3975-406d-9022-8fabe834a74d tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-00b72b2c-849a-45ad-9a0a-7fdcf7b9b292-delete_snapshot" released by "delete_snapshot" :: held 3.090s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-4bb83790-22cf-484a-a107-a07d2563647a req-2e1f468a-80c6-499f-a559-e54553ef330c tempest-TestServerVolumeAttachmentScenario-552909398 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-b4eca535-bf24-4e11-9c51-437be649a322', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '89c62c66-a2bb-4e7c-b411-7c385c5cb10c', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:49:00 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-4bb83790-22cf-484a-a107-a07d2563647a req-2e1f468a-80c6-499f-a559-e54553ef330c tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-4bb83790-22cf-484a-a107-a07d2563647a req-2e1f468a-80c6-499f-a559-e54553ef330c tempest-TestServerVolumeAttachmentScenario-552909398 None] attachment_update completed successfully. Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "cinder-c770b3da-6789-4d7a-a1a5-e31dddd230ba-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-c770b3da-6789-4d7a-a1a5-e31dddd230ba-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:49:00 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2238b5af-05bd-49fb-b7dc-6e86012ca8e5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba" returned: 0 in 0.483s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c770b3da-6789-4d7a-a1a5-e31dddd230ba" returned: 0 in 0.090s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-quobyte-c770b3da-6789-4d7a-a1a5-e31dddd230ba" released by "delete_volume" :: held 0.735s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Created reservations ['84f2911c-fedb-4a7f-b38e-71a3f5fefc79', '29a3234c-a6cc-464a-90f7-5ea9adc032f4', '6e02f67d-2fb5-42ba-88a9-9b22222762d1', 'cea3fbc2-f379-48b9-ba74-103f80e79f46'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.111s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:49:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Deleted volume successfully. Sep 16 01:49:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-10b81b7d-fa2d-49f6-90e1-d0103a3db8c4 tempest-SnapshotsActionsTest-1025636570 None] Lock "cinder-c770b3da-6789-4d7a-a1a5-e31dddd230ba-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:49:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:49:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:49:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.115s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:49:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-350a81eb-68c3-4c3f-bfbc-a6e72ccfd343 req-cc86d785-d285-4fce-b6bb-ca2b7415d01a tempest-TestMinimumBasicScenario-1044707550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-350a81eb-68c3-4c3f-bfbc-a6e72ccfd343 req-cc86d785-d285-4fce-b6bb-ca2b7415d01a tempest-TestMinimumBasicScenario-1044707550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:06 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-350a81eb-68c3-4c3f-bfbc-a6e72ccfd343 req-cc86d785-d285-4fce-b6bb-ca2b7415d01a tempest-TestMinimumBasicScenario-1044707550 None] Terminate volume connection completed successfully. Sep 16 01:49:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-350a81eb-68c3-4c3f-bfbc-a6e72ccfd343 req-cc86d785-d285-4fce-b6bb-ca2b7415d01a tempest-TestMinimumBasicScenario-1044707550 None] Deleting attachment 15b132c2-07c5-45ad-95d6-cfde260c2aca. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:49:07 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Acquiring lock "cinder-02718319-58ad-4379-be4c-f04bdb866f13-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:49:07 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Lock "cinder-02718319-58ad-4379-be4c-f04bdb866f13-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:49:07 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:08 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Acquiring lock "cinder-quobyte-02718319-58ad-4379-be4c-f04bdb866f13" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:49:08 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Lock "cinder-quobyte-02718319-58ad-4379-be4c-f04bdb866f13" acquired by "delete_volume" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:49:08 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[330496c8-1d91-47f8-942a-e0c9dc1c2c1e]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:49:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13" returned: 0 in 0.526s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02718319-58ad-4379-be4c-f04bdb866f13" returned: 0 in 0.160s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:08 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Lock "cinder-quobyte-02718319-58ad-4379-be4c-f04bdb866f13" released by "delete_volume" :: held 0.964s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Created reservations ['52d2c0df-baf8-4392-9209-7d0f67889632', '48b61f72-7983-4a45-be15-15f1e7a57906', '839d4991-9969-4276-ae3f-907f8f4179da', '9df6e874-d41e-4c13-b52a-cbefd3ef1b30'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.148s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:09 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:49:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Deleted volume successfully. Sep 16 01:49:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-38da2a39-11a0-48d9-a25b-3abdeed13f35 tempest-TestMinimumBasicScenario-1044707550 None] Lock "cinder-02718319-58ad-4379-be4c-f04bdb866f13-delete_volume" released by "delete_volume" :: held 2.185s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-dcb91b3f-9cd3-4426-b83e-1d3f550c5828 req-d9e0d787-faab-409e-b5f8-93f97be932e2 tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-dcb91b3f-9cd3-4426-b83e-1d3f550c5828 req-d9e0d787-faab-409e-b5f8-93f97be932e2 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:14 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[42df7e9c-6e63-4642-9da2-a54bb4160d76]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:49:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-dcb91b3f-9cd3-4426-b83e-1d3f550c5828 req-d9e0d787-faab-409e-b5f8-93f97be932e2 tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-dcb91b3f-9cd3-4426-b83e-1d3f550c5828 req-d9e0d787-faab-409e-b5f8-93f97be932e2 tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3" returned: 0 in 0.691s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-dcb91b3f-9cd3-4426-b83e-1d3f550c5828 req-d9e0d787-faab-409e-b5f8-93f97be932e2 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-dcb91b3f-9cd3-4426-b83e-1d3f550c5828 req-d9e0d787-faab-409e-b5f8-93f97be932e2 tempest-TestServerVolumeAttachmentScenario-552909398 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-80f88ce8-882e-464b-8a45-8c73e3f805a3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bafc9079-c1d0-4ec9-bf64-5f5925c4595f', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:49:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-dcb91b3f-9cd3-4426-b83e-1d3f550c5828 req-d9e0d787-faab-409e-b5f8-93f97be932e2 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-dcb91b3f-9cd3-4426-b83e-1d3f550c5828 req-d9e0d787-faab-409e-b5f8-93f97be932e2 tempest-TestServerVolumeAttachmentScenario-552909398 None] attachment_update completed successfully. Sep 16 01:49:22 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Flow 'volume_create_manager' (31ca1a35-e06c-40c5-a735-3baf6f938fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0054daa5-121a-43d7-9a4d-2827a4271efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0054daa5-121a-43d7-9a4d-2827a4271efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1823661618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ad7afe-d877-49b4-a737-d4e3917ee8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78f321112384592bec16980be553d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:49:22Z,use_quota=True,user_id='8bae056ddcf94688a6cf9dfda8f5887f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(604170e3-1275-443d-9e1e-f1ab1f86548a),volume_type_id=604170e3-1275-443d-9e1e-f1ab1f86548a)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27dd4a10-2890-4bb1-b6a3-4c6425af3766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27dd4a10-2890-4bb1-b6a3-4c6425af3766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039f9b67-6eb8-4ce8-ad42-ce99266c2b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (039f9b67-6eb8-4ce8-ad42-ce99266c2b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7ad7afe-d877-49b4-a737-d4e3917ee8bf', 'volume_name': 'volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e861c8fb-bfea-4334-838b-758b4ab76bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e861c8fb-bfea-4334-838b-758b4ab76bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c554dc32-64d7-4124-92fa-3354cf61f50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:22 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Volume e7ad7afe-d877-49b4-a737-d4e3917ee8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf', 'volume_size': 1} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1823661618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7ad7afe-d877-49b4-a737-d4e3917ee8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c78f321112384592bec16980be553d0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:49:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:49:22Z,use_quota=True,user_id='8bae056ddcf94688a6cf9dfda8f5887f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(604170e3-1275-443d-9e1e-f1ab1f86548a),volume_type_id=604170e3-1275-443d-9e1e-f1ab1f86548a)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Creating volume e7ad7afe-d877-49b4-a737-d4e3917ee8bf {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:49:22 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:49:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:22 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=99, name=volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf 1073741824" returned: 0 in 0.440s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf" returned: 0 in 0.219s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] <== create_volume: return (809ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c554dc32-64d7-4124-92fa-3354cf61f50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13a32f8-2188-4a91-9bc4-d6643c130343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:23 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Volume volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf (e7ad7afe-d877-49b4-a737-d4e3917ee8bf): created successfully Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13a32f8-2188-4a91-9bc4-d6643c130343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Flow 'volume_create_manager' (31ca1a35-e06c-40c5-a735-3baf6f938fe7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:49:23 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-708fd441-0767-4b22-9f69-c046bcb259c5 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Created volume successfully. Sep 16 01:49:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:49:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:49:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.122s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:25 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:49:25 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-cd209922-7142-4dcb-9620-f551c0b260ed tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Retype volume completed successfully. Sep 16 01:49:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Acquiring lock "cinder-e7ad7afe-d877-49b4-a737-d4e3917ee8bf-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:49:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "cinder-e7ad7afe-d877-49b4-a737-d4e3917ee8bf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:49:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Acquiring lock "cinder-quobyte-e7ad7afe-d877-49b4-a737-d4e3917ee8bf" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:49:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "cinder-quobyte-e7ad7afe-d877-49b4-a737-d4e3917ee8bf" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:49:26 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c65684-ece5-4b4c-891b-2be2319ca0d6]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:49:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf" returned: 0 in 0.506s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e7ad7afe-d877-49b4-a737-d4e3917ee8bf" returned: 0 in 0.102s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "cinder-quobyte-e7ad7afe-d877-49b4-a737-d4e3917ee8bf" released by "delete_volume" :: held 0.797s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:27 devstack cinder-volume[83041]: WARNING cinder.quota [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:49:27 devstack cinder-volume[83041]: WARNING cinder.quota [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Created reservations ['2147a10c-5877-43bd-bf32-b38188f1033f', 'f1ef8d84-76a7-499a-8d61-e9927739f19f', 'c93cad17-e9f5-4772-9e08-c01b966c2b60', 'b0c112b8-24f9-435e-9edd-76c1f86e927a'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.118s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:49:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Deleted volume successfully. Sep 16 01:49:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8a01fd91-3a9c-4903-a49c-9b6082fd87a7 tempest-VolumeRetypeWithoutMigrationTest-1485928781 None] Lock "cinder-e7ad7afe-d877-49b4-a737-d4e3917ee8bf-delete_volume" released by "delete_volume" :: held 2.051s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:37 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Flow 'volume_create_manager' (92469995-1c69-4ac0-93da-396c2486904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397a6cec-6131-4a89-a647-6e9fee90e01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (397a6cec-6131-4a89-a647-6e9fee90e01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-881616040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ecba84-28b5-4f2b-89ec-764db68738b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e33a66a4c054469f8018ac06af73d4ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:49:37Z,use_quota=True,user_id='2b34b97867d34e62a3a0041de4ac1bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fbea53-73cd-484e-ba57-df05e7671f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25fbea53-73cd-484e-ba57-df05e7671f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6a3855-1c40-402b-8535-6c0fd6b8e49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad6a3855-1c40-402b-8535-6c0fd6b8e49f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39ecba84-28b5-4f2b-89ec-764db68738b3', 'volume_name': 'volume-39ecba84-28b5-4f2b-89ec-764db68738b3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db949116-b280-4f45-8fc6-a4c45161a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db949116-b280-4f45-8fc6-a4c45161a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303ed99e-bbef-4d57-a38b-b9a41197e6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:37 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Volume 39ecba84-28b5-4f2b-89ec-764db68738b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39ecba84-28b5-4f2b-89ec-764db68738b3', 'volume_size': 1} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:49:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-881616040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39ecba84-28b5-4f2b-89ec-764db68738b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e33a66a4c054469f8018ac06af73d4ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:49:37Z,use_quota=True,user_id='2b34b97867d34e62a3a0041de4ac1bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Creating volume 39ecba84-28b5-4f2b-89ec-764db68738b3 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:49:37 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:49:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39ecba84-28b5-4f2b-89ec-764db68738b3 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:37 devstack quobyte-client[83066]: System call of process 95021 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:49:37 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=100, name=volume-39ecba84-28b5-4f2b-89ec-764db68738b3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39ecba84-28b5-4f2b-89ec-764db68738b3 1073741824" returned: 0 in 0.430s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39ecba84-28b5-4f2b-89ec-764db68738b3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39ecba84-28b5-4f2b-89ec-764db68738b3" returned: 0 in 0.207s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] <== create_volume: return (742ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (303ed99e-bbef-4d57-a38b-b9a41197e6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39ecba84-28b5-4f2b-89ec-764db68738b3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50688765-b566-487a-8ec7-88a7d4f3310a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:49:38 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Volume volume-39ecba84-28b5-4f2b-89ec-764db68738b3 (39ecba84-28b5-4f2b-89ec-764db68738b3): created successfully Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50688765-b566-487a-8ec7-88a7d4f3310a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:49:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Flow 'volume_create_manager' (92469995-1c69-4ac0-93da-396c2486904a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:49:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5cbf9263-5480-4f25-8023-86b9f9e8e2ee tempest-VolumesServicesTestJSON-1710227945 None] Created volume successfully. Sep 16 01:49:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Acquiring lock "cinder-39ecba84-28b5-4f2b-89ec-764db68738b3-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:49:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Lock "cinder-39ecba84-28b5-4f2b-89ec-764db68738b3-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:49:39 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Acquiring lock "cinder-quobyte-39ecba84-28b5-4f2b-89ec-764db68738b3" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:49:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Lock "cinder-quobyte-39ecba84-28b5-4f2b-89ec-764db68738b3" acquired by "delete_volume" :: waited 0.017s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:49:39 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fb20c6-78ff-4bb0-ae02-0ce6c2c9585a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:49:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39ecba84-28b5-4f2b-89ec-764db68738b3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39ecba84-28b5-4f2b-89ec-764db68738b3" returned: 0 in 0.461s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39ecba84-28b5-4f2b-89ec-764db68738b3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39ecba84-28b5-4f2b-89ec-764db68738b3" returned: 0 in 0.125s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Lock "cinder-quobyte-39ecba84-28b5-4f2b-89ec-764db68738b3" released by "delete_volume" :: held 0.744s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:40 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Created reservations ['c5dc7e8e-2971-4a9b-8da6-389bb1d08f25', '85f71245-f052-4892-b3aa-e8f698a87d5d', '010e60c6-f9e1-4646-b7e6-8fe589316cb9', '98959f98-72c6-43ae-80b6-495417ef23a9'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.130s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:49:41 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Deleted volume successfully. Sep 16 01:49:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c4d3854-379e-4149-ae58-b81f6fe5ae7f tempest-VolumesServicesTestJSON-1710227945 None] Lock "cinder-39ecba84-28b5-4f2b-89ec-764db68738b3-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:49:43 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-62bdcdc2-3886-4e52-bc53-5b837b6f6347 req-c5a5889a-215c-4559-8e7a-77029a0e0b58 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:44 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=81,cinder:SELECT=60,cinder:DELETE=5,cinder:INSERT=13 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:49:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-62bdcdc2-3886-4e52-bc53-5b837b6f6347 req-c5a5889a-215c-4559-8e7a-77029a0e0b58 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:49:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-62bdcdc2-3886-4e52-bc53-5b837b6f6347 req-c5a5889a-215c-4559-8e7a-77029a0e0b58 tempest-TestServerVolumeAttachmentScenario-552909398 None] Terminate volume connection completed successfully. Sep 16 01:49:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-62bdcdc2-3886-4e52-bc53-5b837b6f6347 req-c5a5889a-215c-4559-8e7a-77029a0e0b58 tempest-TestServerVolumeAttachmentScenario-552909398 None] Deleting attachment bafc9079-c1d0-4ec9-bf64-5f5925c4595f. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:49:53 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=58,cinder:INSERT=15,cinder:UPDATE=51,cinder:DELETE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:50:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:50:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:50:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:50:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:50:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:50:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:50:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.147s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:50:07 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:50:07 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Flow 'volume_create_manager' (4cd27958-3369-44e5-9e6c-82ac8747d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fb6818-9141-43ad-a9bb-f95394453438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fb6818-9141-43ad-a9bb-f95394453438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2142845580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6056b457-cb55-4150-9792-312457e00787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97395ec665ed4d31bf4776381dcbb109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:50:08Z,use_quota=True,user_id='f9bc0a3fcbee4b05aedd81d4b729aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b890a22e-626b-4a85-b824-3f7b904247c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b890a22e-626b-4a85-b824-3f7b904247c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62f6601-e700-48d9-b2fd-5bb8810dfcc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.image.glance [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Creating Keystone auth plugin from conf {{(pid=83041) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 01:50:08 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-e8e26efb-6bb3-45d3-8b48-f13bc6d1ef17 req-4acd024d-0f2f-44bc-bb34-fdfd443a11a4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:50:08 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-e8e26efb-6bb3-45d3-8b48-f13bc6d1ef17 req-4acd024d-0f2f-44bc-bb34-fdfd443a11a4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:50:08 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-e8e26efb-6bb3-45d3-8b48-f13bc6d1ef17 req-4acd024d-0f2f-44bc-bb34-fdfd443a11a4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Terminate volume connection completed successfully. Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-e8e26efb-6bb3-45d3-8b48-f13bc6d1ef17 req-4acd024d-0f2f-44bc-bb34-fdfd443a11a4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Deleting attachment 89c62c66-a2bb-4e7c-b411-7c385c5cb10c. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d62f6601-e700-48d9-b2fd-5bb8810dfcc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6056b457-cb55-4150-9792-312457e00787', 'volume_name': 'volume-6056b457-cb55-4150-9792-312457e00787', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638ba7de-224c-4665-8423-cf6546556f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638ba7de-224c-4665-8423-cf6546556f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b02e14-d8f9-440e-9c27-5a7caf64bb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:50:08 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Volume 6056b457-cb55-4150-9792-312457e00787: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6056b457-cb55-4150-9792-312457e00787', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 16 01:50:08 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Cloning 6056b457-cb55-4150-9792-312457e00787 from image 4fb31587-8398-4719-bd55-69963b8198da at location (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]). {{(pid=83041) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 01:50:09 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 01:50:09 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Image download 20.69 MB at 20.69 MB/s Sep 16 01:50:09 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[637ae33b-e12f-4f09-88e5-51f30c58d1e8]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:50:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:10 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD Sep 16 01:50:10 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:50:13 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Sep 16 01:50:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD" returned: 0 in 3.849s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:13 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Temporary image 4fb31587-8398-4719-bd55-69963b8198da is fetched for user f9bc0a3fcbee4b05aedd81d4b729aebe. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 01:50:14 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1e227c-fb20-4314-aae8-22d40d9f44e8]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:50:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:14 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD Sep 16 01:50:14 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:50:18 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Sep 16 01:50:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD" returned: 0 in 4.739s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:50:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:50:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2142845580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6056b457-cb55-4150-9792-312457e00787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97395ec665ed4d31bf4776381dcbb109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:50:08Z,use_quota=True,user_id='f9bc0a3fcbee4b05aedd81d4b729aebe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Creating volume 6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:50:19 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:50:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:19 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=101, name=volume-6056b457-cb55-4150-9792-312457e00787, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:50:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 1073741824" returned: 0 in 0.819s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 0 in 0.235s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] <== create_volume: return (1315ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:50:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:50:20 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Attempting download of 4fb31587-8398-4719-bd55-69963b8198da ((None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}])) to volume 6056b457-cb55-4150-9792-312457e00787. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 01:50:20 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[be58dfd7-3bf8-4d13-8e61-71cf6e9032de]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:50:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_kewjjbcb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_kewjjbcb" returned: 0 in 0.546s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_kewjjbcb {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_kewjjbcb" returned: 1 in 0.426s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4fb31587-8398-4719-bd55-69963b8198da_kewjjbcb' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:50:22 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f3b02b-b361-400b-bb68-bb312821fcbb]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:50:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:22 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] 4fb31587-8398-4719-bd55-69963b8198da was qcow2, converting to raw {{(pid=83041) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 01:50:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:22 devstack quobyte-client[83066]: System call of process 95158 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:50:22 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=101, name=volume-6056b457-cb55-4150-9792-312457e00787, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:50:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 0 in 1.311s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:23 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4fb31587-8398-4719-bd55-69963b8198da_ghnyywm3devstack@QuobyteHD, size 112.00 MB, duration 1.38 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:50:23 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Converted 112.00 MB image at 81.42 MB/s Sep 16 01:50:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 1G" returned: 0 in 0.225s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:24 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[317a5f56-85c5-45ac-9a2f-a065ed019d37]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:50:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 0 in 0.504s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "cinder-80f88ce8-882e-464b-8a45-8c73e3f805a3-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 1 in 0.678s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Downloaded image 4fb31587-8398-4719-bd55-69963b8198da ((None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}])) to volume 6056b457-cb55-4150-9792-312457e00787 successfully. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Temporary image 4fb31587-8398-4719-bd55-69963b8198da for user f9bc0a3fcbee4b05aedd81d4b729aebe is deleted. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Marking volume 6056b457-cb55-4150-9792-312457e00787 as bootable. {{(pid=83041) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Copying metadata from image 4fb31587-8398-4719-bd55-69963b8198da to 6056b457-cb55-4150-9792-312457e00787. {{(pid=83041) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Creating volume glance metadata for volume 6056b457-cb55-4150-9792-312457e00787 backed by image 4fb31587-8398-4719-bd55-69963b8198da with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=83041) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 01:50:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "cinder-80f88ce8-882e-464b-8a45-8c73e3f805a3-delete_volume" acquired by "delete_volume" :: waited 0.309s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:50:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "cinder-quobyte-80f88ce8-882e-464b-8a45-8c73e3f805a3" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "cinder-quobyte-80f88ce8-882e-464b-8a45-8c73e3f805a3" acquired by "delete_volume" :: waited 0.055s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[293d1537-764a-4626-863c-91e49f8abf7d]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48b02e14-d8f9-440e-9c27-5a7caf64bb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6056b457-cb55-4150-9792-312457e00787', 'volume_size': 1, 'image_id': '4fb31587-8398-4719-bd55-69963b8198da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4fb31587-8398-4719-bd55-69963b8198da', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '99ab92b50e254f33b54e26effdc9aba2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4fb31587-8398-4719-bd55-69963b8198da', 'created_at': datetime.datetime(2025, 9, 15, 23, 15, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 15, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4fb31587-8398-4719-bd55-69963b8198da/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4543992e-1958-4418-97a9-576eb23b6385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:50:26 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Volume volume-6056b457-cb55-4150-9792-312457e00787 (6056b457-cb55-4150-9792-312457e00787): created successfully Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4543992e-1958-4418-97a9-576eb23b6385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Flow 'volume_create_manager' (4cd27958-3369-44e5-9e6c-82ac8747d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:50:26 devstack quobyte-client[83066]: System call of process 95173 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3" returned: 0 in 0.758s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4652de6d-84e6-4e18-8c94-8ff9bd0ed2ea tempest-TestShelveInstance-965338382 None] Created volume successfully. Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-80f88ce8-882e-464b-8a45-8c73e3f805a3" returned: 0 in 0.240s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "cinder-quobyte-80f88ce8-882e-464b-8a45-8c73e3f805a3" released by "delete_volume" :: held 1.146s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Created reservations ['9c6dad83-d317-4396-b762-925dfe2152b4', 'f500e2d3-8512-40b5-a09d-864fa0541ed2', 'e787942d-bd9a-4f61-866f-0aa2d0894b1f', '6e08ff40-912f-4908-ad57-f944b74470fb'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:50:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "cinder-b4eca535-bf24-4e11-9c51-437be649a322-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:50:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.595s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:28 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:50:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Deleted volume successfully. Sep 16 01:50:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "cinder-b4eca535-bf24-4e11-9c51-437be649a322-delete_volume" acquired by "delete_volume" :: waited 0.405s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:50:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8183a228-f24d-421d-85b3-724c9be8ecb4 tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "cinder-80f88ce8-882e-464b-8a45-8c73e3f805a3-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:50:28 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:50:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "cinder-quobyte-b4eca535-bf24-4e11-9c51-437be649a322" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:50:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "cinder-quobyte-b4eca535-bf24-4e11-9c51-437be649a322" acquired by "delete_volume" :: waited 0.022s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:50:29 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[040bcbd2-0de1-4bf4-9a07-046e1b39593c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:50:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322" returned: 0 in 0.800s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b4eca535-bf24-4e11-9c51-437be649a322" returned: 0 in 0.094s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "cinder-quobyte-b4eca535-bf24-4e11-9c51-437be649a322" released by "delete_volume" :: held 1.074s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Created reservations ['aa40b192-ba29-4fe3-8071-9f968901097d', '2071a3ea-8738-4e83-a640-e191272833c8', '2ce615e3-adf5-4f48-985a-a023bb613614', '08d23839-eb99-4874-aeea-81f3fb5c697f'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.163s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:30 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:50:30 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Deleted volume successfully. Sep 16 01:50:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df486e98-8cf7-4fe6-b9c9-ce20feb323fa tempest-TestServerVolumeAttachmentScenario-552909398 None] Lock "cinder-b4eca535-bf24-4e11-9c51-437be649a322-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:50:40 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=16,cinder:SELECT=18,cinder:INSERT=9,cinder:DELETE=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:50:41 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=22,cinder:UPDATE=24,cinder:INSERT=12,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:50:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:50:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:50:42 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f59b25-5efc-4d3d-afb4-de56e5478667]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:50:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:42 devstack quobyte-client[83066]: System call of process 95253 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:50:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 0 in 0.628s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:50:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 1 in 0.652s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:50:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:50:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.484s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:50:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-6056b457-cb55-4150-9792-312457e00787', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3103bb8b-a267-4b8c-a211-746492d78639', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:50:43 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:50:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-89cc8c1d-5bd4-46bd-a3df-68e8a1b129fb req-dce4e9b5-72bc-4243-9f31-faea21f001ae tempest-TestShelveInstance-965338382 None] attachment_update completed successfully. Sep 16 01:50:54 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:50:54 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:51:02 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:02 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:51:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (adc94f0c-5ce1-4f7a-8d4e-9949226e2e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:02 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52d65e4-0451-4e34-9b03-64b2522df1ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52d65e4-0451-4e34-9b03-64b2522df1ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1591634540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e894af-d09b-41da-8770-20b622f1f2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:03Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb95d02-c5ce-4475-a1a8-f69449e217ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb95d02-c5ce-4475-a1a8-f69449e217ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445302ae-91b8-4e4b-bf79-1d2abef46498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (445302ae-91b8-4e4b-bf79-1d2abef46498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05e894af-d09b-41da-8770-20b622f1f2e6', 'volume_name': 'volume-05e894af-d09b-41da-8770-20b622f1f2e6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42f0de3-5976-48f6-9596-48d21a020448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c42f0de3-5976-48f6-9596-48d21a020448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd609ec-b6d1-4b7b-943e-599f0ef8e3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:03 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Volume 05e894af-d09b-41da-8770-20b622f1f2e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05e894af-d09b-41da-8770-20b622f1f2e6', 'volume_size': 1} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1591634540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05e894af-d09b-41da-8770-20b622f1f2e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:03Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Creating volume 05e894af-d09b-41da-8770-20b622f1f2e6 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:51:03 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-05e894af-d09b-41da-8770-20b622f1f2e6 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:03 devstack quobyte-client[83066]: System call of process 95820 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:51:03 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=102, name=volume-05e894af-d09b-41da-8770-20b622f1f2e6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-05e894af-d09b-41da-8770-20b622f1f2e6 1073741824" returned: 0 in 0.679s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-05e894af-d09b-41da-8770-20b622f1f2e6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-05e894af-d09b-41da-8770-20b622f1f2e6" returned: 0 in 0.201s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] <== create_volume: return (1008ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbd609ec-b6d1-4b7b-943e-599f0ef8e3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05e894af-d09b-41da-8770-20b622f1f2e6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d9792a-78e1-4c7e-9e96-024243ff95e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:04 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Volume volume-05e894af-d09b-41da-8770-20b622f1f2e6 (05e894af-d09b-41da-8770-20b622f1f2e6): created successfully Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1d9792a-78e1-4c7e-9e96-024243ff95e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (adc94f0c-5ce1-4f7a-8d4e-9949226e2e4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:04 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-19594c85-59f4-42f8-a072-40f6042dbf6d tempest-VolumesActionsTest-869342014 None] Created volume successfully. Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.252s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:51:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-24f23da6-401b-4626-84ac-b719da926965 tempest-VolumesActionsTest-869342014 None] Acquiring lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6" by "attach_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-24f23da6-401b-4626-84ac-b719da926965 tempest-VolumesActionsTest-869342014 None] Lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6" acquired by "attach_volume" :: waited 0.119s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-24f23da6-401b-4626-84ac-b719da926965 tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:06 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-24f23da6-401b-4626-84ac-b719da926965 tempest-VolumesActionsTest-869342014 None] Attaching volume 05e894af-d09b-41da-8770-20b622f1f2e6 to instance ceaf2e84-866e-4abe-bca1-d179d6234ac9 at mountpoint /dev/vdb on host None. Sep 16 01:51:07 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-24f23da6-401b-4626-84ac-b719da926965 tempest-VolumesActionsTest-869342014 None] Attach volume completed successfully. Sep 16 01:51:07 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-24f23da6-401b-4626-84ac-b719da926965 tempest-VolumesActionsTest-869342014 None] Lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6" released by "attach_volume" :: held 1.282s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:09 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Terminate volume connection completed successfully. Sep 16 01:51:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-detach_volume" by "detach_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:10 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Detaching volume 05e894af-d09b-41da-8770-20b622f1f2e6 from instance ceaf2e84-866e-4abe-bca1-d179d6234ac9. Sep 16 01:51:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:10 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Detach volume completed successfully. Sep 16 01:51:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-0a662db1-69e6-4390-9d56-5e40a281e2c6 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-detach_volume" released by "detach_volume" :: held 0.198s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dfb2e6cf-0706-4c2b-91ff-9664ff1e8738 tempest-VolumesActionsTest-869342014 None] Acquiring lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-detach_volume" by "detach_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dfb2e6cf-0706-4c2b-91ff-9664ff1e8738 tempest-VolumesActionsTest-869342014 None] Lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:11 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dfb2e6cf-0706-4c2b-91ff-9664ff1e8738 tempest-VolumesActionsTest-869342014 None] Volume detach called, but volume not attached. Sep 16 01:51:11 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dfb2e6cf-0706-4c2b-91ff-9664ff1e8738 tempest-VolumesActionsTest-869342014 None] Lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Acquiring lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Acquiring lock "cinder-quobyte-05e894af-d09b-41da-8770-20b622f1f2e6" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Lock "cinder-quobyte-05e894af-d09b-41da-8770-20b622f1f2e6" acquired by "delete_volume" :: waited 0.054s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:12 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fceffe2-3340-4c12-ad2b-ad96c35fc2ea]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:51:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-05e894af-d09b-41da-8770-20b622f1f2e6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-05e894af-d09b-41da-8770-20b622f1f2e6" returned: 0 in 1.983s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-05e894af-d09b-41da-8770-20b622f1f2e6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-05e894af-d09b-41da-8770-20b622f1f2e6" returned: 0 in 0.540s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Lock "cinder-quobyte-05e894af-d09b-41da-8770-20b622f1f2e6" released by "delete_volume" :: held 2.909s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Created reservations ['a4f7d576-371d-4166-bd4b-5d6d10afea63', '4b59a75c-4c23-4967-a721-769c27cb3970', 'e0132eac-b73b-4488-ac04-2c25b9c83e62', '9e52dfbd-9307-4dbf-aeef-8059e9cc5b5a'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.194s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:16 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:51:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Deleted volume successfully. Sep 16 01:51:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-07aa733b-322b-4a96-a328-18bf1f8d6cb7 tempest-VolumesActionsTest-869342014 None] Lock "cinder-05e894af-d09b-41da-8770-20b622f1f2e6-delete_volume" released by "delete_volume" :: held 4.551s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (1f7a22b1-7624-47ab-9cb1-cd61b75a5464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b3d6d6-9f43-497c-8e86-9a3516a926a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b3d6d6-9f43-497c-8e86-9a3516a926a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1508898875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b59276-ca08-4031-84cf-863cca7a052e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:26Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84305af8-f1ab-46a5-896f-a662b7211db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84305af8-f1ab-46a5-896f-a662b7211db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423b89f2-f369-4043-b810-0cb77b81ac4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423b89f2-f369-4043-b810-0cb77b81ac4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35b59276-ca08-4031-84cf-863cca7a052e', 'volume_name': 'volume-35b59276-ca08-4031-84cf-863cca7a052e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc1b281-c3f4-4190-acb7-301fad612dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc1b281-c3f4-4190-acb7-301fad612dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899286fb-d43b-41ba-a3fb-be98b963f7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:25 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Volume 35b59276-ca08-4031-84cf-863cca7a052e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35b59276-ca08-4031-84cf-863cca7a052e', 'volume_size': 1} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1508898875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35b59276-ca08-4031-84cf-863cca7a052e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:26Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Creating volume 35b59276-ca08-4031-84cf-863cca7a052e {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:51:25 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:51:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-35b59276-ca08-4031-84cf-863cca7a052e 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:26 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=103, name=volume-35b59276-ca08-4031-84cf-863cca7a052e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-35b59276-ca08-4031-84cf-863cca7a052e 1073741824" returned: 0 in 0.374s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-35b59276-ca08-4031-84cf-863cca7a052e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-35b59276-ca08-4031-84cf-863cca7a052e" returned: 0 in 0.093s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] <== create_volume: return (542ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.556s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (899286fb-d43b-41ba-a3fb-be98b963f7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35b59276-ca08-4031-84cf-863cca7a052e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880d16b4-0ca7-421b-b757-67c0b719d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:26 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Volume volume-35b59276-ca08-4031-84cf-863cca7a052e (35b59276-ca08-4031-84cf-863cca7a052e): created successfully Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (880d16b4-0ca7-421b-b757-67c0b719d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (1f7a22b1-7624-47ab-9cb1-cd61b75a5464) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:26 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-a71c3fd9-c75d-40d8-9515-78bd98d114ac tempest-VolumesActionsTest-869342014 None] Created volume successfully. Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-35b59276-ca08-4031-84cf-863cca7a052e-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-35b59276-ca08-4031-84cf-863cca7a052e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:28 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-quobyte-35b59276-ca08-4031-84cf-863cca7a052e" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-quobyte-35b59276-ca08-4031-84cf-863cca7a052e" acquired by "delete_volume" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[20eeba56-359c-4fbb-a241-021ecb866e3f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-35b59276-ca08-4031-84cf-863cca7a052e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-35b59276-ca08-4031-84cf-863cca7a052e" returned: 0 in 0.431s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-35b59276-ca08-4031-84cf-863cca7a052e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-35b59276-ca08-4031-84cf-863cca7a052e" returned: 0 in 0.130s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-quobyte-35b59276-ca08-4031-84cf-863cca7a052e" released by "delete_volume" :: held 0.720s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Created reservations ['901c1343-f13e-4982-af21-e33c236bed97', '3677be83-e487-489f-abfa-463cde9097bf', 'b32405a3-4666-4a43-a86c-3308ceeb44f1', '1af56f47-2091-47ec-8888-80d7e39328f6'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.100s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:51:29 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Deleted volume successfully. Sep 16 01:51:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bd8fc224-daf1-400e-b27b-ef3fc79c77a4 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-35b59276-ca08-4031-84cf-863cca7a052e-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:30 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:30 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:51:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (d3aca1d3-2e50-4d37-a450-700832cb89e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8ba689-9a8c-4c41-b8f6-d61d855179fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b8ba689-9a8c-4c41-b8f6-d61d855179fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1123600310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74adeacd-f551-4b2d-93f7-cf90a9e67994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:31Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2430dcc-b206-45db-942d-0ba867c6671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2430dcc-b206-45db-942d-0ba867c6671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48e10bf-9ed4-4ac5-83ff-e943ebeb949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b48e10bf-9ed4-4ac5-83ff-e943ebeb949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74adeacd-f551-4b2d-93f7-cf90a9e67994', 'volume_name': 'volume-74adeacd-f551-4b2d-93f7-cf90a9e67994', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0927a376-c4dc-4569-877c-9d42c741e375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0927a376-c4dc-4569-877c-9d42c741e375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6601ceed-059b-4f53-9b50-1e27312161ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:31 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Volume 74adeacd-f551-4b2d-93f7-cf90a9e67994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74adeacd-f551-4b2d-93f7-cf90a9e67994', 'volume_size': 1} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1123600310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74adeacd-f551-4b2d-93f7-cf90a9e67994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:31Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Creating volume 74adeacd-f551-4b2d-93f7-cf90a9e67994 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:51:31 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-74adeacd-f551-4b2d-93f7-cf90a9e67994 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:31 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=104, name=volume-74adeacd-f551-4b2d-93f7-cf90a9e67994, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-74adeacd-f551-4b2d-93f7-cf90a9e67994 1073741824" returned: 0 in 0.333s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-74adeacd-f551-4b2d-93f7-cf90a9e67994 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-74adeacd-f551-4b2d-93f7-cf90a9e67994" returned: 0 in 0.087s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] <== create_volume: return (493ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.507s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6601ceed-059b-4f53-9b50-1e27312161ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74adeacd-f551-4b2d-93f7-cf90a9e67994', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d66218b-6bc6-4d66-9da2-965fc3fcd494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:31 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Volume volume-74adeacd-f551-4b2d-93f7-cf90a9e67994 (74adeacd-f551-4b2d-93f7-cf90a9e67994): created successfully Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d66218b-6bc6-4d66-9da2-965fc3fcd494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (d3aca1d3-2e50-4d37-a450-700832cb89e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-006e2d3b-bacb-46dd-8e6a-c73cdcb29895 tempest-VolumesActionsTest-869342014 None] Created volume successfully. Sep 16 01:51:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-74adeacd-f551-4b2d-93f7-cf90a9e67994-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Lock "cinder-74adeacd-f551-4b2d-93f7-cf90a9e67994-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:33 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-quobyte-74adeacd-f551-4b2d-93f7-cf90a9e67994" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Lock "cinder-quobyte-74adeacd-f551-4b2d-93f7-cf90a9e67994" acquired by "delete_volume" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:33 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[52345f7d-f17c-4000-8f17-5e9d80eb0749]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:51:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-74adeacd-f551-4b2d-93f7-cf90a9e67994 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-74adeacd-f551-4b2d-93f7-cf90a9e67994" returned: 0 in 0.458s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-74adeacd-f551-4b2d-93f7-cf90a9e67994 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-74adeacd-f551-4b2d-93f7-cf90a9e67994" returned: 0 in 0.133s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Lock "cinder-quobyte-74adeacd-f551-4b2d-93f7-cf90a9e67994" released by "delete_volume" :: held 0.771s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Created reservations ['ee16b5b7-19a8-4769-b1d0-cbacc9987f23', '02b1465e-efe4-4d94-83f6-cd0c6a2afabd', 'f9b96c81-7fd0-4ff0-b09b-970bb1da9ae9', '26bed0ca-55a0-469f-b7eb-dd1c7afbf99e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.089s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:34 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:51:34 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Deleted volume successfully. Sep 16 01:51:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e40e2115-3362-4a1b-bf6c-7beaa10c906c tempest-VolumesActionsTest-1371671474 None] Lock "cinder-74adeacd-f551-4b2d-93f7-cf90a9e67994-delete_volume" released by "delete_volume" :: held 1.801s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:36 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:51:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (f1d36736-1b05-4ec1-a787-323873743862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba763074-47c6-4896-af77-7c86778c2d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba763074-47c6-4896-af77-7c86778c2d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480687971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb76d94-041e-4681-b48b-313e9285eff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:36Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b863cc-318b-406c-b2ca-56630d8d56ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b863cc-318b-406c-b2ca-56630d8d56ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6853a0-7060-488f-a52e-1ecf200b2f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea6853a0-7060-488f-a52e-1ecf200b2f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6eb76d94-041e-4681-b48b-313e9285eff6', 'volume_name': 'volume-6eb76d94-041e-4681-b48b-313e9285eff6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65a11d5-8f4d-4b09-b1b9-1d4fc00b94a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f65a11d5-8f4d-4b09-b1b9-1d4fc00b94a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5b5ed1-b37c-453d-8b9e-7c1585102c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:37 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Volume 6eb76d94-041e-4681-b48b-313e9285eff6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6eb76d94-041e-4681-b48b-313e9285eff6', 'volume_size': 1} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1480687971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6eb76d94-041e-4681-b48b-313e9285eff6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:36Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Creating volume 6eb76d94-041e-4681-b48b-313e9285eff6 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:51:37 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6eb76d94-041e-4681-b48b-313e9285eff6 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:37 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=105, name=volume-6eb76d94-041e-4681-b48b-313e9285eff6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6eb76d94-041e-4681-b48b-313e9285eff6 1073741824" returned: 0 in 0.528s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6eb76d94-041e-4681-b48b-313e9285eff6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6eb76d94-041e-4681-b48b-313e9285eff6" returned: 0 in 0.104s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] <== create_volume: return (769ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:51:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca5b5ed1-b37c-453d-8b9e-7c1585102c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6eb76d94-041e-4681-b48b-313e9285eff6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479abfb0-d3e1-4dbd-9c9b-567247cba605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:38 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Volume volume-6eb76d94-041e-4681-b48b-313e9285eff6 (6eb76d94-041e-4681-b48b-313e9285eff6): created successfully Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (479abfb0-d3e1-4dbd-9c9b-567247cba605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (f1d36736-1b05-4ec1-a787-323873743862) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-facc890f-3c12-4740-be4e-f3949878b4ef tempest-VolumesActionsTest-869342014 None] Created volume successfully. Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-6eb76d94-041e-4681-b48b-313e9285eff6-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-6eb76d94-041e-4681-b48b-313e9285eff6-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:38 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-quobyte-6eb76d94-041e-4681-b48b-313e9285eff6" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-quobyte-6eb76d94-041e-4681-b48b-313e9285eff6" acquired by "delete_volume" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9acfed-88f9-4e2b-906e-97f84ebf8cf8]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:51:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6eb76d94-041e-4681-b48b-313e9285eff6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6eb76d94-041e-4681-b48b-313e9285eff6" returned: 0 in 0.520s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6eb76d94-041e-4681-b48b-313e9285eff6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6eb76d94-041e-4681-b48b-313e9285eff6" returned: 0 in 0.104s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-quobyte-6eb76d94-041e-4681-b48b-313e9285eff6" released by "delete_volume" :: held 0.801s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Created reservations ['e11d64e9-7421-4767-b240-576290dd90e2', '2ad1c277-aea2-4478-83f5-54042e637916', '5062497f-0f95-41c7-8c2f-7d05bc76ff96', '47a297ca-dedb-4611-bdfb-4caab19bf0b4'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.108s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:51:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Deleted volume successfully. Sep 16 01:51:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4e936881-381c-4dad-b5f2-c9acd1b72819 tempest-VolumesActionsTest-1371671474 None] Lock "cinder-6eb76d94-041e-4681-b48b-313e9285eff6-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (4d24b37a-3273-4ee2-ad72-bcbee583e6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703a2bbf-7756-4f01-aab1-b95830bac616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (703a2bbf-7756-4f01-aab1-b95830bac616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1787217574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58576852-0615-42ff-8dfd-7f9f31c29521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:41Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd11aef-49df-436a-b0a7-9ff0d389b537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd11aef-49df-436a-b0a7-9ff0d389b537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe687ed-9e3c-4843-8505-5dc8fa2f94e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe687ed-9e3c-4843-8505-5dc8fa2f94e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58576852-0615-42ff-8dfd-7f9f31c29521', 'volume_name': 'volume-58576852-0615-42ff-8dfd-7f9f31c29521', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a1ebf0-a57d-42aa-9a3b-337d483a817e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84a1ebf0-a57d-42aa-9a3b-337d483a817e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb3f020-9af6-4911-acb9-1924d9b77037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:41 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Volume 58576852-0615-42ff-8dfd-7f9f31c29521: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58576852-0615-42ff-8dfd-7f9f31c29521', 'volume_size': 1} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1787217574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58576852-0615-42ff-8dfd-7f9f31c29521,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:41Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Creating volume 58576852-0615-42ff-8dfd-7f9f31c29521 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:51:41 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:51:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-58576852-0615-42ff-8dfd-7f9f31c29521 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:41 devstack quobyte-client[83066]: System call of process 95979 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:51:41 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=106, name=volume-58576852-0615-42ff-8dfd-7f9f31c29521, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-58576852-0615-42ff-8dfd-7f9f31c29521 1073741824" returned: 0 in 0.367s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-58576852-0615-42ff-8dfd-7f9f31c29521 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-58576852-0615-42ff-8dfd-7f9f31c29521" returned: 0 in 0.104s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] <== create_volume: return (542ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.555s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ccb3f020-9af6-4911-acb9-1924d9b77037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58576852-0615-42ff-8dfd-7f9f31c29521', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8875752e-fabb-4402-8356-4cbf10e4e096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:42 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Volume volume-58576852-0615-42ff-8dfd-7f9f31c29521 (58576852-0615-42ff-8dfd-7f9f31c29521): created successfully Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8875752e-fabb-4402-8356-4cbf10e4e096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (4d24b37a-3273-4ee2-ad72-bcbee583e6c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:42 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dfd0e915-5693-496d-8f8e-becc0cfdfba0 tempest-VolumesActionsTest-869342014 None] Created volume successfully. Sep 16 01:51:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-58576852-0615-42ff-8dfd-7f9f31c29521-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Lock "cinder-58576852-0615-42ff-8dfd-7f9f31c29521-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Acquiring lock "cinder-quobyte-58576852-0615-42ff-8dfd-7f9f31c29521" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Lock "cinder-quobyte-58576852-0615-42ff-8dfd-7f9f31c29521" acquired by "delete_volume" :: waited 0.010s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ce6bd-2bdd-4599-a593-3c084805d0a2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-58576852-0615-42ff-8dfd-7f9f31c29521 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-58576852-0615-42ff-8dfd-7f9f31c29521" returned: 0 in 0.427s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-58576852-0615-42ff-8dfd-7f9f31c29521 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-58576852-0615-42ff-8dfd-7f9f31c29521" returned: 0 in 0.091s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Lock "cinder-quobyte-58576852-0615-42ff-8dfd-7f9f31c29521" released by "delete_volume" :: held 0.671s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:44 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Created reservations ['62f51a13-75a3-4ffe-a092-253eb268b9ed', '7ad02521-3fde-4c3a-bb47-594f1dbbbff8', '373a32b3-b7dd-43b0-80e9-52a1f7446b6d', '990a7168-424d-49f6-b201-5f8335642144'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.085s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:51:45 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Deleted volume successfully. Sep 16 01:51:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8288544f-59db-4907-b3e7-d44a3009a0cf tempest-VolumesActionsTest-1371671474 None] Lock "cinder-58576852-0615-42ff-8dfd-7f9f31c29521-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:46 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (6a486560-18c6-4de8-b00b-6f31079332b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dceb45d1-b891-4109-91b5-a963d4ff973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dceb45d1-b891-4109-91b5-a963d4ff973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1212096198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c8f01-fed2-4de3-83a0-168e54a2a340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:46Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0b5e7b-2ba7-4df9-baba-fab741b24163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a0b5e7b-2ba7-4df9-baba-fab741b24163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8de32a0-1a75-4ed9-8fe0-2c42d05e8b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8de32a0-1a75-4ed9-8fe0-2c42d05e8b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94c8f01-fed2-4de3-83a0-168e54a2a340', 'volume_name': 'volume-b94c8f01-fed2-4de3-83a0-168e54a2a340', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2704ae-2b93-4716-9661-0740a97752c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d2704ae-2b93-4716-9661-0740a97752c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a03a09-a3fb-4369-a472-498260505213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:46 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Volume b94c8f01-fed2-4de3-83a0-168e54a2a340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94c8f01-fed2-4de3-83a0-168e54a2a340', 'volume_size': 1} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1212096198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c8f01-fed2-4de3-83a0-168e54a2a340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e55a9888c93b42719f80bd9a40b36298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:51:46Z,use_quota=True,user_id='967692c7a4164b61b171ea4222d77350',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Creating volume b94c8f01-fed2-4de3-83a0-168e54a2a340 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:51:46 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:51:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b94c8f01-fed2-4de3-83a0-168e54a2a340 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:46 devstack quobyte-client[83066]: System call of process 95989 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:51:46 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=107, name=volume-b94c8f01-fed2-4de3-83a0-168e54a2a340, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b94c8f01-fed2-4de3-83a0-168e54a2a340 1073741824" returned: 0 in 0.296s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b94c8f01-fed2-4de3-83a0-168e54a2a340 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b94c8f01-fed2-4de3-83a0-168e54a2a340" returned: 0 in 0.095s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] <== create_volume: return (461ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.474s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a03a09-a3fb-4369-a472-498260505213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94c8f01-fed2-4de3-83a0-168e54a2a340', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b2b375-7e7c-436c-a4ef-72c0b648c38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:51:47 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Volume volume-b94c8f01-fed2-4de3-83a0-168e54a2a340 (b94c8f01-fed2-4de3-83a0-168e54a2a340): created successfully Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94b2b375-7e7c-436c-a4ef-72c0b648c38a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:51:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Flow 'volume_create_manager' (6a486560-18c6-4de8-b00b-6f31079332b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:51:47 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8b2a4aef-729b-4373-9f50-aab8bb624cd6 tempest-VolumesActionsTest-869342014 None] Created volume successfully. Sep 16 01:51:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Acquiring lock "cinder-b94c8f01-fed2-4de3-83a0-168e54a2a340-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Lock "cinder-b94c8f01-fed2-4de3-83a0-168e54a2a340-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:49 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:51:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Acquiring lock "cinder-quobyte-b94c8f01-fed2-4de3-83a0-168e54a2a340" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:51:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Lock "cinder-quobyte-b94c8f01-fed2-4de3-83a0-168e54a2a340" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:51:49 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b263805-fff8-4990-ab80-ee45ef1d9dcb]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:51:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b94c8f01-fed2-4de3-83a0-168e54a2a340 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b94c8f01-fed2-4de3-83a0-168e54a2a340" returned: 0 in 0.445s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b94c8f01-fed2-4de3-83a0-168e54a2a340 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b94c8f01-fed2-4de3-83a0-168e54a2a340" returned: 0 in 0.096s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Lock "cinder-quobyte-b94c8f01-fed2-4de3-83a0-168e54a2a340" released by "delete_volume" :: held 0.709s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Created reservations ['9df1932a-74f1-442a-971f-8e14a14b35db', '124f70d0-3bd1-4877-adc4-652aa9167ca8', '7ca2ba5c-90d1-486d-ad1d-a697e9ee53ea', '5f093fc1-18fe-4115-9a0c-fb632a75e478'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:51:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:51:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:51:51 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:51:51 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Deleted volume successfully. Sep 16 01:51:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d0b78052-4f1b-4b59-90bf-aa1aee716dec tempest-VolumesActionsTest-869342014 None] Lock "cinder-b94c8f01-fed2-4de3-83a0-168e54a2a340-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:00 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=46,cinder:UPDATE=57,cinder:DELETE=7,cinder:INSERT=16 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:52:01 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=41,cinder:UPDATE=70,cinder:INSERT=10,cinder:DELETE=5 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:52:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:52:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.137s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:52:09 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Flow 'volume_create_manager' (2bf2b7f0-1635-4db5-a491-a5ac40052cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e27857d-e10c-49a9-b313-fbc8c3fff8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e27857d-e10c-49a9-b313-fbc8c3fff8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1155144733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc96639d-4b9e-478e-a71a-1c4d2aac70b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422104475d2e4bdc891981096594b515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:09Z,use_quota=True,user_id='05bc4cf4803048a3acbfa4cd99767327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a940c0-be7d-4538-b963-26a80f1d8f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5a940c0-be7d-4538-b963-26a80f1d8f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab983ed2-7f77-4578-8818-e41eda3fa920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab983ed2-7f77-4578-8818-e41eda3fa920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc96639d-4b9e-478e-a71a-1c4d2aac70b0', 'volume_name': 'volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62f3895-ee5e-4143-b37a-a58c51bd97c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b62f3895-ee5e-4143-b37a-a58c51bd97c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac83103-318c-492a-9b9d-421b30283043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:09 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Volume cc96639d-4b9e-478e-a71a-1c4d2aac70b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0', 'volume_size': 1} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1155144733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc96639d-4b9e-478e-a71a-1c4d2aac70b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='422104475d2e4bdc891981096594b515',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:09Z,use_quota=True,user_id='05bc4cf4803048a3acbfa4cd99767327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Creating volume cc96639d-4b9e-478e-a71a-1c4d2aac70b0 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:52:09 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:09 devstack quobyte-client[83066]: System call of process 96026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:52:09 devstack quobyte-client[83066]: System call of process 96026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:52:09 devstack quobyte-client[83066]: System call of process 96026 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:52:09 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=108, name=volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 1073741824" returned: 0 in 0.299s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" returned: 0 in 0.080s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] <== create_volume: return (441ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.457s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ac83103-318c-492a-9b9d-421b30283043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dbf6e1-0821-4c19-b3fe-450bf3ac3bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:09 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Volume volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 (cc96639d-4b9e-478e-a71a-1c4d2aac70b0): created successfully Sep 16 01:52:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85dbf6e1-0821-4c19-b3fe-450bf3ac3bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Flow 'volume_create_manager' (2bf2b7f0-1635-4db5-a491-a5ac40052cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:10 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-7d3153c8-30ad-46b3-84f2-da0bf21aec64 tempest-SnapshotMetadataTestJSON-935012585 None] Created volume successfully. Sep 16 01:52:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Creating offline snapshot ddcfa167-1ba6-465a-9e71-854f555284c5 of volume cc96639d-4b9e-478e-a71a-1c4d2aac70b0 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:52:11 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc79b314-e23f-42a4-9fb1-310a54c8f8de]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:52:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" returned: 0 in 0.384s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:11 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=109, name=volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 1G" returned: 0 in 0.212s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): qemu-img rebase -u -b volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] CMD "qemu-img rebase -u -b volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5" returned: 0 in 0.171s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5" returned: 0 in 0.086s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5" returned: 0 in 0.100s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.info" returned: 0 in 0.087s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.info" returned: 0 in 0.087s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.437s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:13 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-fb80d49c-c541-4a63-bbe7-0c3d21cace4b tempest-SnapshotMetadataTestJSON-935012585 None] Create snapshot completed successfully Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "cinder-ddcfa167-1ba6-465a-9e71-854f555284c5-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-ddcfa167-1ba6-465a-9e71-854f555284c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.090s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:14 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "cinder-quobyte-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-quobyte-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "cinder-quobyte-ddcfa167-1ba6-465a-9e71-854f555284c5" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-quobyte-ddcfa167-1ba6-465a-9e71-854f555284c5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Deleting offline snapshot ddcfa167-1ba6-465a-9e71-854f555284c5 of volume cc96639d-4b9e-478e-a71a-1c4d2aac70b0 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] snapshot_file for this snap is: volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff756d7-d33e-4dc3-bd99-f4528daa8857]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5" returned: 0 in 0.429s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b62295-30a8-49f6-98d2-207c05e23add]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:52:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:15 devstack quobyte-client[83066]: System call of process 96050 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:52:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" returned: 0 in 0.467s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:15 devstack quobyte-client[83066]: System call of process 96056 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:52:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5" returned: 0 in 0.283s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0.ddcfa167-1ba6-465a-9e71-854f555284c5" returned: 0 in 0.160s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-quobyte-ddcfa167-1ba6-465a-9e71-854f555284c5" released by "_delete_snapshot" :: held 1.686s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-quobyte-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" released by "delete_snapshot" :: held 1.713s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:16 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Created reservations ['a471838f-84d4-46c1-a8ae-62d3bd8390b8', '749117e5-7fb3-4e87-9d93-09366cba7ee1', '945b106d-9e68-4526-9c7b-51ef91181538', '936eee79-b162-417a-a174-ef9c955e80f4'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:52:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Delete snapshot completed successfully. Sep 16 01:52:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8dcf1594-0ea4-4f9e-86a9-86f3226e04f5 tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-ddcfa167-1ba6-465a-9e71-854f555284c5-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "cinder-cc96639d-4b9e-478e-a71a-1c4d2aac70b0-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:18 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-cc96639d-4b9e-478e-a71a-1c4d2aac70b0-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:18 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:18 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "cinder-quobyte-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:18 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-quobyte-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" acquired by "delete_volume" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:18 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe84fde-d5b4-4706-a75e-5cdb5cb870a5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:52:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" returned: 0 in 0.977s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" returned: 0 in 0.125s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-quobyte-cc96639d-4b9e-478e-a71a-1c4d2aac70b0" released by "delete_volume" :: held 1.325s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Created reservations ['f9ab7a93-1011-4a9a-846c-f65ad5ed4f6b', '3b899657-9e99-430d-98bd-95d6acd77884', 'cb7eb5e0-4862-4f0c-a3ae-652b2b802edf', '7206ee66-0c71-4ebe-95d4-6bb134c9652d'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.112s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:20 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:52:20 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Deleted volume successfully. Sep 16 01:52:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-569d1cf7-0ca1-46c6-816e-8d38b6ce62db tempest-SnapshotMetadataTestJSON-935012585 None] Lock "cinder-cc96639d-4b9e-478e-a71a-1c4d2aac70b0-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-bfb494b5-56d6-4e31-b304-ae8107a296f0 req-1960bf81-c99c-4162-b124-08118c4f441f tempest-TestShelveInstance-965338382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-bfb494b5-56d6-4e31-b304-ae8107a296f0 req-1960bf81-c99c-4162-b124-08118c4f441f tempest-TestShelveInstance-965338382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:26 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-bfb494b5-56d6-4e31-b304-ae8107a296f0 req-1960bf81-c99c-4162-b124-08118c4f441f tempest-TestShelveInstance-965338382 None] Terminate volume connection completed successfully. Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-bfb494b5-56d6-4e31-b304-ae8107a296f0 req-1960bf81-c99c-4162-b124-08118c4f441f tempest-TestShelveInstance-965338382 None] Deleting attachment 3103bb8b-a267-4b8c-a211-746492d78639. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:52:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Flow 'volume_create_manager' (07cc8add-ddff-4f91-bbb7-c7d779ba6126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc405b22-dfb0-445b-9f7d-81d98a59fa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc405b22-dfb0-445b-9f7d-81d98a59fa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1495112354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d2f0ef72a34d618cabd77b583d0b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:27Z,use_quota=True,user_id='c2740c28af634c01a563822c757dca45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0180cc-0ad5-4fab-8b76-c882b5de167d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0180cc-0ad5-4fab-8b76-c882b5de167d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ff489b-e882-4739-a7e5-641f666c3cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3ff489b-e882-4739-a7e5-641f666c3cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4', 'volume_name': 'volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a973b96-943b-4702-bfcf-bd44d374b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a973b96-943b-4702-bfcf-bd44d374b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f225b63-0123-45e9-a149-537f12ba797a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:27 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Volume f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4', 'volume_size': 1} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1495112354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3d2f0ef72a34d618cabd77b583d0b11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:27Z,use_quota=True,user_id='c2740c28af634c01a563822c757dca45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Creating volume f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:52:27 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:27 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=111, name=volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4 1073741824" returned: 0 in 0.357s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4" returned: 0 in 0.121s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] <== create_volume: return (561ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.575s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f225b63-0123-45e9-a149-537f12ba797a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b713fb-ebf0-49a5-aa9a-8ea6d0610398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:27 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Volume volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4 (f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4): created successfully Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b713fb-ebf0-49a5-aa9a-8ea6d0610398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:27 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Flow 'volume_create_manager' (07cc8add-ddff-4f91-bbb7-c7d779ba6126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3588f562-14ad-4cdd-8f6f-4f31032d10f3 tempest-VolumesMetadataTest-1253315143 None] Created volume successfully. Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Acquiring lock "cinder-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Lock "cinder-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:30 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Acquiring lock "cinder-quobyte-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Lock "cinder-quobyte-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6454ed4-160c-47e0-b43f-61064aa0e5bb]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4" returned: 0 in 0.422s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4" returned: 0 in 0.127s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Lock "cinder-quobyte-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4" released by "delete_volume" :: held 0.714s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Created reservations ['5816a9ff-7499-4abc-9ba3-ee679536e24e', 'f6090e7c-a310-4b76-b23e-2502d9b8334f', 'cf6cb28d-5b79-40a9-a6b3-05156c127b3c', 'a8d0299a-6663-4007-af39-c4850ac9561b'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.079s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:52:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Deleted volume successfully. Sep 16 01:52:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6874322a-5269-4657-9fcd-c9a2fcd973f4 tempest-VolumesMetadataTest-1253315143 None] Lock "cinder-f43dbef0-4b8c-4d46-99ec-11bd2e5e83b4-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:33 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[765abb2a-3ac8-4802-b84b-08e4af921f3e]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:52:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 0 in 0.446s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 1 in 0.484s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:52:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.122s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-6056b457-cb55-4150-9792-312457e00787', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5af8cc2e-e124-453c-8e58-3e720b38db45', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:52:34 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:35 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-7f6a29fa-8ac6-42a3-a32c-47db7645e5f4 req-7195ab48-98b1-493d-84fd-1278e48979d6 tempest-TestShelveInstance-965338382 None] attachment_update completed successfully. Sep 16 01:52:37 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Flow 'volume_create_manager' (38f63db9-e288-43a8-adaf-59dbd3351c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a36c54d-eb99-490a-afd9-560a0090820d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a36c54d-eb99-490a-afd9-560a0090820d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1047036158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc50cc2-2580-4758-9011-78ee121adb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ee10777e2a45aabfa89418985bc573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:37Z,use_quota=True,user_id='449176b30cd44791a25f9a1812b3d7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d553caeb-8b22-4e1c-91ef-9eb2187b9269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d553caeb-8b22-4e1c-91ef-9eb2187b9269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac158f0-a48a-4edd-b408-5234e65b4ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ac158f0-a48a-4edd-b408-5234e65b4ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc50cc2-2580-4758-9011-78ee121adb72', 'volume_name': 'volume-bdc50cc2-2580-4758-9011-78ee121adb72', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4c7460-27ce-42ac-b249-18fce69dff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4c7460-27ce-42ac-b249-18fce69dff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee731af-f8a7-48a2-9fa0-d57eede33908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:37 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Volume bdc50cc2-2580-4758-9011-78ee121adb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc50cc2-2580-4758-9011-78ee121adb72', 'volume_size': 1} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1047036158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc50cc2-2580-4758-9011-78ee121adb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ee10777e2a45aabfa89418985bc573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:37Z,use_quota=True,user_id='449176b30cd44791a25f9a1812b3d7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Creating volume bdc50cc2-2580-4758-9011-78ee121adb72 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:52:37 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bdc50cc2-2580-4758-9011-78ee121adb72 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:37 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=112, name=volume-bdc50cc2-2580-4758-9011-78ee121adb72, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bdc50cc2-2580-4758-9011-78ee121adb72 1073741824" returned: 0 in 0.364s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bdc50cc2-2580-4758-9011-78ee121adb72 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bdc50cc2-2580-4758-9011-78ee121adb72" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] <== create_volume: return (550ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:52:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.570s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ee731af-f8a7-48a2-9fa0-d57eede33908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc50cc2-2580-4758-9011-78ee121adb72', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3547b9c3-71bf-48f0-8eb2-5843f081fc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:38 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Volume volume-bdc50cc2-2580-4758-9011-78ee121adb72 (bdc50cc2-2580-4758-9011-78ee121adb72): created successfully Sep 16 01:52:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3547b9c3-71bf-48f0-8eb2-5843f081fc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Flow 'volume_create_manager' (38f63db9-e288-43a8-adaf-59dbd3351c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0c24e7f7-eec5-441e-ac02-0317d54e215b tempest-VolumesTransfersTest-467295543 None] Created volume successfully. Sep 16 01:52:39 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-914e018d-8c7a-41a1-9be0-a4671711fbea tempest-VolumesTransfersTest-1496982169 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:39 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-914e018d-8c7a-41a1-9be0-a4671711fbea tempest-VolumesTransfersTest-1496982169 None] Transfer volume completed successfully. Sep 16 01:52:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Acquiring lock "cinder-bdc50cc2-2580-4758-9011-78ee121adb72-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Lock "cinder-bdc50cc2-2580-4758-9011-78ee121adb72-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:40 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Acquiring lock "cinder-quobyte-bdc50cc2-2580-4758-9011-78ee121adb72" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Lock "cinder-quobyte-bdc50cc2-2580-4758-9011-78ee121adb72" acquired by "delete_volume" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:40 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[487e8bfb-e9a5-4758-ba4d-e50096edb393]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:52:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bdc50cc2-2580-4758-9011-78ee121adb72 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bdc50cc2-2580-4758-9011-78ee121adb72" returned: 0 in 0.410s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bdc50cc2-2580-4758-9011-78ee121adb72 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bdc50cc2-2580-4758-9011-78ee121adb72" returned: 0 in 0.109s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Lock "cinder-quobyte-bdc50cc2-2580-4758-9011-78ee121adb72" released by "delete_volume" :: held 0.660s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Created reservations ['072696d0-3197-4794-ba34-19492f430c48', 'f54a7d83-dfd3-4eba-ac40-251430fd1517', 'dcd3841c-f5dd-4f9f-af53-f855a0e58c82', 'a7db2497-70e9-4742-ad06-31beea4ef3bd'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.134s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:42 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:52:42 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Deleted volume successfully. Sep 16 01:52:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-df471eb5-0ccf-4539-916e-397173d652f9 tempest-VolumesTransfersTest-650283397 None] Lock "cinder-bdc50cc2-2580-4758-9011-78ee121adb72-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:43 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Flow 'volume_create_manager' (a1383aca-b372-44c3-bc98-330d2d27761e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492b23cd-66ae-4b37-9d3b-9979d472092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (492b23cd-66ae-4b37-9d3b-9979d472092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1368189444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a551f64e-bfab-44e3-a8fb-3c39939b734c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ee10777e2a45aabfa89418985bc573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:43Z,use_quota=True,user_id='449176b30cd44791a25f9a1812b3d7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9753bd11-df3f-4bb8-909a-d1b98240fd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9753bd11-df3f-4bb8-909a-d1b98240fd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6a6ba5-51a4-4de8-b7f8-b27a0c4a4f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e6a6ba5-51a4-4de8-b7f8-b27a0c4a4f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a551f64e-bfab-44e3-a8fb-3c39939b734c', 'volume_name': 'volume-a551f64e-bfab-44e3-a8fb-3c39939b734c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ac6239-3817-4262-94f7-3e7c44ae9d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ac6239-3817-4262-94f7-3e7c44ae9d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e2f66e-2e85-419c-923c-a100b0c15736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:43 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Volume a551f64e-bfab-44e3-a8fb-3c39939b734c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a551f64e-bfab-44e3-a8fb-3c39939b734c', 'volume_size': 1} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1368189444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a551f64e-bfab-44e3-a8fb-3c39939b734c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58ee10777e2a45aabfa89418985bc573',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:43Z,use_quota=True,user_id='449176b30cd44791a25f9a1812b3d7c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Creating volume a551f64e-bfab-44e3-a8fb-3c39939b734c {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:52:43 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:52:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a551f64e-bfab-44e3-a8fb-3c39939b734c 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:43 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=113, name=volume-a551f64e-bfab-44e3-a8fb-3c39939b734c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:52:43 devstack quobyte-client[83066]: System call of process 96186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a551f64e-bfab-44e3-a8fb-3c39939b734c 1073741824" returned: 0 in 0.324s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a551f64e-bfab-44e3-a8fb-3c39939b734c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a551f64e-bfab-44e3-a8fb-3c39939b734c" returned: 0 in 0.086s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] <== create_volume: return (480ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.493s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82e2f66e-2e85-419c-923c-a100b0c15736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a551f64e-bfab-44e3-a8fb-3c39939b734c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773360e9-f477-4ff3-a694-0247d38f10ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:44 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Volume volume-a551f64e-bfab-44e3-a8fb-3c39939b734c (a551f64e-bfab-44e3-a8fb-3c39939b734c): created successfully Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (773360e9-f477-4ff3-a694-0247d38f10ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Flow 'volume_create_manager' (a1383aca-b372-44c3-bc98-330d2d27761e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-92fd2eda-f14f-4488-b0b3-362a21c3b63f tempest-VolumesTransfersTest-467295543 None] Created volume successfully. Sep 16 01:52:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Acquiring lock "cinder-a551f64e-bfab-44e3-a8fb-3c39939b734c-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Lock "cinder-a551f64e-bfab-44e3-a8fb-3c39939b734c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:46 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Acquiring lock "cinder-quobyte-a551f64e-bfab-44e3-a8fb-3c39939b734c" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Lock "cinder-quobyte-a551f64e-bfab-44e3-a8fb-3c39939b734c" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[900d3116-7299-463c-93ab-1f7e086e9793]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a551f64e-bfab-44e3-a8fb-3c39939b734c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a551f64e-bfab-44e3-a8fb-3c39939b734c" returned: 0 in 0.374s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a551f64e-bfab-44e3-a8fb-3c39939b734c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a551f64e-bfab-44e3-a8fb-3c39939b734c" returned: 0 in 0.141s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:46 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Lock "cinder-quobyte-a551f64e-bfab-44e3-a8fb-3c39939b734c" released by "delete_volume" :: held 0.693s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Created reservations ['375833a4-a8f0-46a9-a247-43ff9aa29305', '0b4c07ff-d145-4e36-b2ca-eb1b243a7e0e', 'e2cdf4ff-833d-4e1d-81a4-7aa8c85d267b', 'd5f5cae2-a145-4c3f-87fc-0c7f014cd161'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:52:47 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Deleted volume successfully. Sep 16 01:52:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-dff16857-e1ce-4e48-b644-6194cc170be3 tempest-VolumesTransfersTest-650283397 None] Lock "cinder-a551f64e-bfab-44e3-a8fb-3c39939b734c-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:52:57 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=37,cinder:UPDATE=35,cinder:DELETE=2,cinder:INSERT=7 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:52:57 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=38,cinder:UPDATE=62,cinder:DELETE=7,cinder:INSERT=13 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:52:58 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Flow 'volume_create_manager' (2aa3a78c-b9b1-4b01-af53-d30a43077b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae89438e-b960-4677-b597-c29dead4a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae89438e-b960-4677-b597-c29dead4a551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1600517157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0914cf7c-0f16-4513-af8c-0d7e993beb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e541831411dd4731ac8b15f9e0c7a4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:58Z,use_quota=True,user_id='107b777f5546413aae23012a460c6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0f1f81-c31e-4957-94a1-6535ce089394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0f1f81-c31e-4957-94a1-6535ce089394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3763e6-7420-4d8b-86b6-37f435e3e9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3763e6-7420-4d8b-86b6-37f435e3e9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0914cf7c-0f16-4513-af8c-0d7e993beb5e', 'volume_name': 'volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ef4d15-0bfc-4dd5-bd52-8c9e75751c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63ef4d15-0bfc-4dd5-bd52-8c9e75751c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3471891d-f435-41ad-ad35-49e1095c4322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:58 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Volume 0914cf7c-0f16-4513-af8c-0d7e993beb5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e', 'volume_size': 1} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1600517157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0914cf7c-0f16-4513-af8c-0d7e993beb5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e541831411dd4731ac8b15f9e0c7a4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:52:58Z,use_quota=True,user_id='107b777f5546413aae23012a460c6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Creating volume 0914cf7c-0f16-4513-af8c-0d7e993beb5e {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:52:58 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:52:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:58 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=114, name=volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:52:58 devstack quobyte-client[83066]: System call of process 96658 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e 1073741824" returned: 0 in 0.323s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e" returned: 0 in 0.102s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] <== create_volume: return (500ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.513s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3471891d-f435-41ad-ad35-49e1095c4322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3248d2ac-21fd-4b21-8c70-dc9a6db25c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:52:59 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Volume volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e (0914cf7c-0f16-4513-af8c-0d7e993beb5e): created successfully Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3248d2ac-21fd-4b21-8c70-dc9a6db25c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:52:59 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Flow 'volume_create_manager' (2aa3a78c-b9b1-4b01-af53-d30a43077b6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:52:59 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-189c7c84-eeca-4d38-bd95-bfc15961e59d tempest-VolumesTransfersV357Test-1783403827 None] Created volume successfully. Sep 16 01:53:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0b4f3720-7fcf-4564-b0d1-bec54c6d3a2e tempest-VolumesTransfersV357Test-611201406 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:53:01 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0b4f3720-7fcf-4564-b0d1-bec54c6d3a2e tempest-VolumesTransfersV357Test-611201406 None] Transfer volume completed successfully. Sep 16 01:53:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Acquiring lock "cinder-0914cf7c-0f16-4513-af8c-0d7e993beb5e-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:53:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Lock "cinder-0914cf7c-0f16-4513-af8c-0d7e993beb5e-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:53:02 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:53:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Acquiring lock "cinder-quobyte-0914cf7c-0f16-4513-af8c-0d7e993beb5e" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:53:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Lock "cinder-quobyte-0914cf7c-0f16-4513-af8c-0d7e993beb5e" acquired by "delete_volume" :: waited 0.025s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:53:02 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab98a78a-71da-4ee3-ad72-b53aaec8af00]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:53:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e" returned: 0 in 0.469s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0914cf7c-0f16-4513-af8c-0d7e993beb5e" returned: 0 in 0.119s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Lock "cinder-quobyte-0914cf7c-0f16-4513-af8c-0d7e993beb5e" released by "delete_volume" :: held 0.754s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Created reservations ['055d0ab5-3965-42e7-8d77-75233873ab60', 'c4f97a84-bfdd-469b-9d92-dbdd42eafdf0', '7337eb4b-27f3-40d8-9853-0839c64996d5', 'b2a8814b-8dcb-43c9-a2b9-3f5fe9599fa4'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.097s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:03 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:53:03 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Deleted volume successfully. Sep 16 01:53:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-bb5cdb0a-6299-44fb-b4fb-2aa81af80535 tempest-VolumesTransfersV357Test-1611953341 None] Lock "cinder-0914cf7c-0f16-4513-af8c-0d7e993beb5e-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:53:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.395s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:53:05 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Flow 'volume_create_manager' (0d651810-de2e-4ef5-bddc-f8b0543a36c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f90b99-1140-487d-8fbe-28441c6190c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f90b99-1140-487d-8fbe-28441c6190c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-442058472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f96858-a118-448c-9218-73d2180b6347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e541831411dd4731ac8b15f9e0c7a4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:53:05Z,use_quota=True,user_id='107b777f5546413aae23012a460c6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42ab766-729b-4c24-ab78-ecdbf74653b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42ab766-729b-4c24-ab78-ecdbf74653b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dd31ba-8d0d-4778-abea-027c1250210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72dd31ba-8d0d-4778-abea-027c1250210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85f96858-a118-448c-9218-73d2180b6347', 'volume_name': 'volume-85f96858-a118-448c-9218-73d2180b6347', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c20156-ed58-4fdc-b4ff-506c2cfb9822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c20156-ed58-4fdc-b4ff-506c2cfb9822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2b6369-c16a-4299-8a35-447ea2ec453a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:05 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Volume 85f96858-a118-448c-9218-73d2180b6347: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85f96858-a118-448c-9218-73d2180b6347', 'volume_size': 1} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:53:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-442058472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85f96858-a118-448c-9218-73d2180b6347,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e541831411dd4731ac8b15f9e0c7a4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:53:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:53:05Z,use_quota=True,user_id='107b777f5546413aae23012a460c6054',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Creating volume 85f96858-a118-448c-9218-73d2180b6347 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:53:05 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:53:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85f96858-a118-448c-9218-73d2180b6347 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:05 devstack quobyte-client[83066]: System call of process 96693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:53:05 devstack quobyte-client[83066]: System call of process 96693 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:53:05 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=115, name=volume-85f96858-a118-448c-9218-73d2180b6347, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85f96858-a118-448c-9218-73d2180b6347 1073741824" returned: 0 in 0.311s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85f96858-a118-448c-9218-73d2180b6347 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85f96858-a118-448c-9218-73d2180b6347" returned: 0 in 0.089s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] <== create_volume: return (484ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.500s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac2b6369-c16a-4299-8a35-447ea2ec453a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85f96858-a118-448c-9218-73d2180b6347', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6316b235-a7fa-4bda-bf07-9b7b5d45ceba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:06 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Volume volume-85f96858-a118-448c-9218-73d2180b6347 (85f96858-a118-448c-9218-73d2180b6347): created successfully Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6316b235-a7fa-4bda-bf07-9b7b5d45ceba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Flow 'volume_create_manager' (0d651810-de2e-4ef5-bddc-f8b0543a36c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:53:06 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-aac7ef07-2672-45f0-a2a6-d884b5a63127 tempest-VolumesTransfersV357Test-1783403827 None] Created volume successfully. Sep 16 01:53:07 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Acquiring lock "cinder-85f96858-a118-448c-9218-73d2180b6347-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:53:07 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Lock "cinder-85f96858-a118-448c-9218-73d2180b6347-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:53:07 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:53:07 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Acquiring lock "cinder-quobyte-85f96858-a118-448c-9218-73d2180b6347" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:53:07 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Lock "cinder-quobyte-85f96858-a118-448c-9218-73d2180b6347" acquired by "delete_volume" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:53:07 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba38cce-02e8-42de-af02-4c995e94278a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:53:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85f96858-a118-448c-9218-73d2180b6347 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85f96858-a118-448c-9218-73d2180b6347" returned: 0 in 0.532s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85f96858-a118-448c-9218-73d2180b6347 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-85f96858-a118-448c-9218-73d2180b6347" returned: 0 in 0.129s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:08 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Lock "cinder-quobyte-85f96858-a118-448c-9218-73d2180b6347" released by "delete_volume" :: held 0.824s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Created reservations ['dbd0a535-3569-4b13-bfc9-af534ed322ae', '9ecfa366-bf6b-4991-8677-de98941d56d2', '7406e27d-2961-4ced-84c0-222e4654cc7d', 'de9b6da7-6f49-4046-8180-2ea3f692085e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.113s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:53:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Deleted volume successfully. Sep 16 01:53:09 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f51ca0e-fc09-4548-9369-efd8a2b6979d tempest-VolumesTransfersV357Test-1611953341 None] Lock "cinder-85f96858-a118-448c-9218-73d2180b6347-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:53:19 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=13,cinder:UPDATE=31,cinder:INSERT=6 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:53:19 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=12,cinder:UPDATE=9,cinder:DELETE=4,cinder:INSERT=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:53:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Flow 'volume_create_manager' (1aaf5761-d579-44bc-8704-6ee4935fbaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f6db6b-8e07-4611-a892-591c398c5514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08f6db6b-8e07-4611-a892-591c398c5514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1833744097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a924a9-22d9-4802-9529-a0c3573a6d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc464fc5370423f8772dc6e21ac9ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:53:25Z,use_quota=True,user_id='67908be8c4aa4d03b75361f4e4dcc9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f6d41a-4ad4-4f05-87d7-048d97eb4f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85f6d41a-4ad4-4f05-87d7-048d97eb4f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206c7d4d-d4fa-45bb-afca-bba1ef11a9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (206c7d4d-d4fa-45bb-afca-bba1ef11a9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39a924a9-22d9-4802-9529-a0c3573a6d7c', 'volume_name': 'volume-39a924a9-22d9-4802-9529-a0c3573a6d7c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306d3fd8-7e39-4553-a95d-02fb75b2d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (306d3fd8-7e39-4553-a95d-02fb75b2d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c141a7-37bb-44ce-b620-0e9d628a6ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:25 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Volume 39a924a9-22d9-4802-9529-a0c3573a6d7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39a924a9-22d9-4802-9529-a0c3573a6d7c', 'volume_size': 1} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:53:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1833744097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39a924a9-22d9-4802-9529-a0c3573a6d7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc464fc5370423f8772dc6e21ac9ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:53:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:53:25Z,use_quota=True,user_id='67908be8c4aa4d03b75361f4e4dcc9f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Creating volume 39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:53:25 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:25 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=116, name=volume-39a924a9-22d9-4802-9529-a0c3573a6d7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c 1073741824" returned: 0 in 0.321s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:53:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.082s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:53:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] <== create_volume: return (471ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:53:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.486s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:53:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82c141a7-37bb-44ce-b620-0e9d628a6ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39a924a9-22d9-4802-9529-a0c3573a6d7c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e31fee2-9e71-4c3d-9ac8-f655bb1c56c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:53:26 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Volume volume-39a924a9-22d9-4802-9529-a0c3573a6d7c (39a924a9-22d9-4802-9529-a0c3573a6d7c): created successfully Sep 16 01:53:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e31fee2-9e71-4c3d-9ac8-f655bb1c56c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:53:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Flow 'volume_create_manager' (1aaf5761-d579-44bc-8704-6ee4935fbaf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:53:26 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-a1cf4421-9b79-4709-b7df-8f545b8a331b tempest-VolumesActionsTest-420257601 None] Created volume successfully. Sep 16 01:53:36 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:53:36 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:53:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-17e48ef4-8095-4b8e-bca9-7e7e86d754c2 tempest-VolumesActionsTest-420257601 None] Acquiring lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c" by "attach_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:53:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-17e48ef4-8095-4b8e-bca9-7e7e86d754c2 tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c" acquired by "attach_volume" :: waited 0.022s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:53:51 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-17e48ef4-8095-4b8e-bca9-7e7e86d754c2 tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:53:51 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-17e48ef4-8095-4b8e-bca9-7e7e86d754c2 tempest-VolumesActionsTest-420257601 None] Attaching volume 39a924a9-22d9-4802-9529-a0c3573a6d7c to instance 9fe8f2b2-7b12-45b4-af68-ae9a4ce8544e at mountpoint /dev/vdb on host None. Sep 16 01:53:52 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-17e48ef4-8095-4b8e-bca9-7e7e86d754c2 tempest-VolumesActionsTest-420257601 None] Attach volume completed successfully. Sep 16 01:53:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-17e48ef4-8095-4b8e-bca9-7e7e86d754c2 tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c" released by "attach_volume" :: held 0.257s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:53:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4fb54aa0-d749-48e6-80ed-bbd3b31aa3df tempest-VolumesActionsTest-420257601 None] Acquiring lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-detach_volume" by "detach_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:53:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4fb54aa0-d749-48e6-80ed-bbd3b31aa3df tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:53:52 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4fb54aa0-d749-48e6-80ed-bbd3b31aa3df tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:53:52 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4fb54aa0-d749-48e6-80ed-bbd3b31aa3df tempest-VolumesActionsTest-420257601 None] Detaching volume 39a924a9-22d9-4802-9529-a0c3573a6d7c from instance 9fe8f2b2-7b12-45b4-af68-ae9a4ce8544e. Sep 16 01:53:52 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4fb54aa0-d749-48e6-80ed-bbd3b31aa3df tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:53:52 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4fb54aa0-d749-48e6-80ed-bbd3b31aa3df tempest-VolumesActionsTest-420257601 None] Detach volume completed successfully. Sep 16 01:53:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4fb54aa0-d749-48e6-80ed-bbd3b31aa3df tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-detach_volume" released by "detach_volume" :: held 0.142s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:02 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:54:02 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=4 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:54:04 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:54:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.077s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.382s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:54:08 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-4a8e18d3-f850-4c12-8ed6-79420c349392 tempest-TestShelveInstance-965338382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:09 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-4a8e18d3-f850-4c12-8ed6-79420c349392 tempest-TestShelveInstance-965338382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:09 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-8415694e-c2bc-456f-8059-1a1775b5222c req-4a8e18d3-f850-4c12-8ed6-79420c349392 tempest-TestShelveInstance-965338382 None] Terminate volume connection completed successfully. Sep 16 01:54:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-8415694e-c2bc-456f-8059-1a1775b5222c req-4a8e18d3-f850-4c12-8ed6-79420c349392 tempest-TestShelveInstance-965338382 None] Deleting attachment 5af8cc2e-e124-453c-8e58-3e720b38db45. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:54:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Acquiring lock "cinder-6056b457-cb55-4150-9792-312457e00787-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Lock "cinder-6056b457-cb55-4150-9792-312457e00787-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Acquiring lock "cinder-quobyte-6056b457-cb55-4150-9792-312457e00787" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:10 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Lock "cinder-quobyte-6056b457-cb55-4150-9792-312457e00787" acquired by "delete_volume" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:10 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[443e63ad-afa4-4dda-a9ba-690d65b76bc0]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 0 in 0.877s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 1 in 0.606s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:54:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-6056b457-cb55-4150-9792-312457e00787" returned: 0 in 0.151s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:12 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Lock "cinder-quobyte-6056b457-cb55-4150-9792-312457e00787" released by "delete_volume" :: held 2.104s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:12 devstack cinder-volume[83041]: DEBUG cinder.quota [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Created reservations ['02772ccb-b16b-4a6f-81bc-df345ae48b6a', '5815600d-d494-44ae-bc66-27f23b1842ed', '95432116-4c85-4e2a-812c-f7e733d0085d', 'd715887c-bd7c-4cea-823e-d17180c11819'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.143s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG cinder.manager [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:54:13 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Deleted volume successfully. Sep 16 01:54:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [req-8415694e-c2bc-456f-8059-1a1775b5222c req-26848aca-5fa2-4f5b-859c-5703c093c8c3 tempest-TestShelveInstance-965338382 None] Lock "cinder-6056b457-cb55-4150-9792-312457e00787-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:23 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:54:23 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:54:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-46a8fe11-9dfd-4d1f-a8b5-f64f69858e0a tempest-VolumesActionsTest-420257601 None] Acquiring lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c" by "attach_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-46a8fe11-9dfd-4d1f-a8b5-f64f69858e0a tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c" acquired by "attach_volume" :: waited 0.061s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:27 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-46a8fe11-9dfd-4d1f-a8b5-f64f69858e0a tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-46a8fe11-9dfd-4d1f-a8b5-f64f69858e0a tempest-VolumesActionsTest-420257601 None] Attaching volume 39a924a9-22d9-4802-9529-a0c3573a6d7c to instance b4e0f1a5-89d5-45fe-909c-2899a707fe99 at mountpoint /dev/vdb on host None. Sep 16 01:54:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-46a8fe11-9dfd-4d1f-a8b5-f64f69858e0a tempest-VolumesActionsTest-420257601 None] Attach volume completed successfully. Sep 16 01:54:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-46a8fe11-9dfd-4d1f-a8b5-f64f69858e0a tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c" released by "attach_volume" :: held 0.275s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b008c9ec-1cad-42bf-a665-757e5408cb61 tempest-VolumesActionsTest-420257601 None] Acquiring lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-detach_volume" by "detach_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b008c9ec-1cad-42bf-a665-757e5408cb61 tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:27 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-b008c9ec-1cad-42bf-a665-757e5408cb61 tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b008c9ec-1cad-42bf-a665-757e5408cb61 tempest-VolumesActionsTest-420257601 None] Detaching volume 39a924a9-22d9-4802-9529-a0c3573a6d7c from instance b4e0f1a5-89d5-45fe-909c-2899a707fe99. Sep 16 01:54:27 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-b008c9ec-1cad-42bf-a665-757e5408cb61 tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b008c9ec-1cad-42bf-a665-757e5408cb61 tempest-VolumesActionsTest-420257601 None] Detach volume completed successfully. Sep 16 01:54:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b008c9ec-1cad-42bf-a665-757e5408cb61 tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:33 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:33 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:54:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (9bc332bb-e648-41c6-80ad-c3fb833367ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47b7883-6870-4357-9c09-ea3963451383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47b7883-6870-4357-9c09-ea3963451383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1061577275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d48c4c-0b63-4f23-a206-491e583b6830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:34Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b361ed9-453f-4a39-b1cd-d16ffd2d8ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b361ed9-453f-4a39-b1cd-d16ffd2d8ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0290ea-e499-49b6-8f79-7004fe7fc1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a0290ea-e499-49b6-8f79-7004fe7fc1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d48c4c-0b63-4f23-a206-491e583b6830', 'volume_name': 'volume-84d48c4c-0b63-4f23-a206-491e583b6830', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444aa03b-befb-45f2-b2a5-bf2a3af93315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (444aa03b-befb-45f2-b2a5-bf2a3af93315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb44c3e6-ab28-41b1-bcf5-03a0250b1ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:34 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Volume 84d48c4c-0b63-4f23-a206-491e583b6830: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d48c4c-0b63-4f23-a206-491e583b6830', 'volume_size': 1} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1061577275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d48c4c-0b63-4f23-a206-491e583b6830,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:34Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Creating volume 84d48c4c-0b63-4f23-a206-491e583b6830 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:54:34 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-84d48c4c-0b63-4f23-a206-491e583b6830 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:34 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=117, name=volume-84d48c4c-0b63-4f23-a206-491e583b6830, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-84d48c4c-0b63-4f23-a206-491e583b6830 1073741824" returned: 0 in 0.569s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-84d48c4c-0b63-4f23-a206-491e583b6830 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:34 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:34 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (a71c9ebc-2197-40dc-9b13-05e9d191b8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a1b557-59d0-492b-99b1-6fd3a1c51f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a1b557-59d0-492b-99b1-6fd3a1c51f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2009779013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e8fd27-48e2-4cd1-9143-2104745224c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:34Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfbf370-fa72-4a6e-9f12-8aee221a9e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfbf370-fa72-4a6e-9f12-8aee221a9e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514c4116-28b0-45c7-9ce7-00677b688ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514c4116-28b0-45c7-9ce7-00677b688ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44e8fd27-48e2-4cd1-9143-2104745224c3', 'volume_name': 'volume-44e8fd27-48e2-4cd1-9143-2104745224c3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f328e89e-da8b-4089-b26b-7e8aaf86efd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f328e89e-da8b-4089-b26b-7e8aaf86efd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c362d5aa-e597-406b-b85b-33380b78eb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:35 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Volume 44e8fd27-48e2-4cd1-9143-2104745224c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44e8fd27-48e2-4cd1-9143-2104745224c3', 'volume_size': 1} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-84d48c4c-0b63-4f23-a206-491e583b6830" returned: 0 in 0.645s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] <== create_volume: return (1267ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.272s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.073s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2009779013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44e8fd27-48e2-4cd1-9143-2104745224c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:34Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Creating volume 44e8fd27-48e2-4cd1-9143-2104745224c3 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:54:35 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-44e8fd27-48e2-4cd1-9143-2104745224c3 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:35 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=118, name=volume-44e8fd27-48e2-4cd1-9143-2104745224c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb44c3e6-ab28-41b1-bcf5-03a0250b1ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d48c4c-0b63-4f23-a206-491e583b6830', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbeab600-177f-40cc-af88-bc91e8b3ae25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:35 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (f5c065dd-9a62-429f-a150-be4fd96274e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f895d37-39c3-42e3-899d-aed890f2bc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f895d37-39c3-42e3-899d-aed890f2bc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1703330169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51feb3fa-79bb-4956-9c7a-45316e5fb718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:35Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc9d9da-4588-4cea-b07c-6e8ea87351ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc9d9da-4588-4cea-b07c-6e8ea87351ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c36526-8e04-45f8-be36-49e7e7a877d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04c36526-8e04-45f8-be36-49e7e7a877d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51feb3fa-79bb-4956-9c7a-45316e5fb718', 'volume_name': 'volume-51feb3fa-79bb-4956-9c7a-45316e5fb718', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08e3f0b-c757-4cc3-8f88-88123596d1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08e3f0b-c757-4cc3-8f88-88123596d1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a69a6e-4339-4130-887d-7d383c3519be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Volume 51feb3fa-79bb-4956-9c7a-45316e5fb718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51feb3fa-79bb-4956-9c7a-45316e5fb718', 'volume_size': 1} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (27b45858-53ad-497a-ba93-a5a2040da576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392452dc-4044-4ab6-af74-d1fd7e1813f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-44e8fd27-48e2-4cd1-9143-2104745224c3 1073741824" returned: 0 in 0.816s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:36 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Volume volume-84d48c4c-0b63-4f23-a206-491e583b6830 (84d48c4c-0b63-4f23-a206-491e583b6830): created successfully Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbeab600-177f-40cc-af88-bc91e8b3ae25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (9bc332bb-e648-41c6-80ad-c3fb833367ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-44e8fd27-48e2-4cd1-9143-2104745224c3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (392452dc-4044-4ab6-af74-d1fd7e1813f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1717784832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd66906e-ec28-44fe-a1fe-9d5262939a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:35Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb4c8db-7156-4cc4-81c7-2901d0cde76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb4c8db-7156-4cc4-81c7-2901d0cde76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e132cb-763f-4ad9-af79-3d66471c4f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e132cb-763f-4ad9-af79-3d66471c4f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd66906e-ec28-44fe-a1fe-9d5262939a14', 'volume_name': 'volume-cd66906e-ec28-44fe-a1fe-9d5262939a14', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a1ada4-f687-4c35-babd-9a2bd62bc0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8a1ada4-f687-4c35-babd-9a2bd62bc0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12424325-4716-4515-9626-0070d7438c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Volume cd66906e-ec28-44fe-a1fe-9d5262939a14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd66906e-ec28-44fe-a1fe-9d5262939a14', 'volume_size': 1} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (7031bb9e-ebdb-4541-aef1-68d643ed6e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a738f48-46ac-4a0f-9a3e-d30a7f7eaf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-098cb740-c4e8-4b0e-9b78-cf6e5a653e51 tempest-CreateVolumesFromImageTest-1956656566 None] Created volume successfully. Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-44e8fd27-48e2-4cd1-9143-2104745224c3" returned: 0 in 0.514s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a738f48-46ac-4a0f-9a3e-d30a7f7eaf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-367574061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba436ded-48d7-4207-9537-870532b3e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:36Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b579fae1-7f7a-4964-96ac-62efefe4b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b579fae1-7f7a-4964-96ac-62efefe4b64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd7c1c5-8088-4e58-8f65-62c52f2480d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dd7c1c5-8088-4e58-8f65-62c52f2480d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba436ded-48d7-4207-9537-870532b3e7c7', 'volume_name': 'volume-ba436ded-48d7-4207-9537-870532b3e7c7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c74dd2-6257-49d1-9a8b-b487e338875d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c74dd2-6257-49d1-9a8b-b487e338875d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5eca0a-d303-4c4b-8e10-bd17f23f0431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:36 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Volume ba436ded-48d7-4207-9537-870532b3e7c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba436ded-48d7-4207-9537-870532b3e7c7', 'volume_size': 1} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] <== create_volume: return (1409ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.681s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1703330169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51feb3fa-79bb-4956-9c7a-45316e5fb718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:35Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Creating volume 51feb3fa-79bb-4956-9c7a-45316e5fb718 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:54:36 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:54:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-51feb3fa-79bb-4956-9c7a-45316e5fb718 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:36 devstack quobyte-client[83066]: System call of process 97168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:54:36 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=119, name=volume-51feb3fa-79bb-4956-9c7a-45316e5fb718, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c362d5aa-e597-406b-b85b-33380b78eb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44e8fd27-48e2-4cd1-9143-2104745224c3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e47d30-2f2c-4477-a844-c9bd492cc67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:37 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Volume volume-44e8fd27-48e2-4cd1-9143-2104745224c3 (44e8fd27-48e2-4cd1-9143-2104745224c3): created successfully Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00e47d30-2f2c-4477-a844-c9bd492cc67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (a71c9ebc-2197-40dc-9b13-05e9d191b8f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:37 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f3cf8fd1-c297-4b31-938c-7309757500f0 tempest-CreateVolumesFromImageTest-1956656566 None] Created volume successfully. Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-51feb3fa-79bb-4956-9c7a-45316e5fb718 1073741824" returned: 0 in 0.507s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-51feb3fa-79bb-4956-9c7a-45316e5fb718 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-51feb3fa-79bb-4956-9c7a-45316e5fb718" returned: 0 in 0.314s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] <== create_volume: return (868ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.248s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1717784832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd66906e-ec28-44fe-a1fe-9d5262939a14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:35Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Creating volume cd66906e-ec28-44fe-a1fe-9d5262939a14 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:54:37 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:54:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cd66906e-ec28-44fe-a1fe-9d5262939a14 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:38 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=120, name=volume-cd66906e-ec28-44fe-a1fe-9d5262939a14, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:54:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a69a6e-4339-4130-887d-7d383c3519be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51feb3fa-79bb-4956-9c7a-45316e5fb718', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f8a596-aff3-4765-8930-b96e061a649c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cd66906e-ec28-44fe-a1fe-9d5262939a14 1073741824" returned: 0 in 0.873s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cd66906e-ec28-44fe-a1fe-9d5262939a14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:38 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Volume volume-51feb3fa-79bb-4956-9c7a-45316e5fb718 (51feb3fa-79bb-4956-9c7a-45316e5fb718): created successfully Sep 16 01:54:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f8a596-aff3-4765-8930-b96e061a649c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (f5c065dd-9a62-429f-a150-be4fd96274e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cd66906e-ec28-44fe-a1fe-9d5262939a14" returned: 0 in 0.523s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] <== create_volume: return (1433ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.508s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:54:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-367574061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba436ded-48d7-4207-9537-870532b3e7c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c50c952f8f6e4d41906b513b9dded10c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:54:36Z,use_quota=True,user_id='2caa7ee31cdd40ae900690fed055927f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Creating volume ba436ded-48d7-4207-9537-870532b3e7c7 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:54:39 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba436ded-48d7-4207-9537-870532b3e7c7 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:39 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=121, name=volume-ba436ded-48d7-4207-9537-870532b3e7c7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:54:39 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5b05e6b5-c515-43a1-8a76-d05dfe5721ea tempest-CreateVolumesFromImageTest-1956656566 None] Created volume successfully. Sep 16 01:54:39 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12424325-4716-4515-9626-0070d7438c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd66906e-ec28-44fe-a1fe-9d5262939a14', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325da1f3-0e70-496c-bde2-28d215b3793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba436ded-48d7-4207-9537-870532b3e7c7 1073741824" returned: 0 in 0.709s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba436ded-48d7-4207-9537-870532b3e7c7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:40 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Volume volume-cd66906e-ec28-44fe-a1fe-9d5262939a14 (cd66906e-ec28-44fe-a1fe-9d5262939a14): created successfully Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325da1f3-0e70-496c-bde2-28d215b3793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (27b45858-53ad-497a-ba93-a5a2040da576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2177e308-c2f3-45fd-b320-7052ca7ea2bf tempest-CreateVolumesFromImageTest-1956656566 None] Created volume successfully. Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba436ded-48d7-4207-9537-870532b3e7c7" returned: 0 in 0.597s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] <== create_volume: return (1356ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5eca0a-d303-4c4b-8e10-bd17f23f0431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba436ded-48d7-4207-9537-870532b3e7c7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cbef259-6517-4f90-a4d2-284c4371d681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:54:40 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Volume volume-ba436ded-48d7-4207-9537-870532b3e7c7 (ba436ded-48d7-4207-9537-870532b3e7c7): created successfully Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cbef259-6517-4f90-a4d2-284c4371d681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:54:40 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Flow 'volume_create_manager' (7031bb9e-ebdb-4541-aef1-68d643ed6e13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:54:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3d92d150-83b8-40df-a6cc-aeda198f5a50 tempest-CreateVolumesFromImageTest-1956656566 None] Created volume successfully. Sep 16 01:54:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:41 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc297c54-296d-4822-bd2f-a33515a2da0f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-ba436ded-48d7-4207-9537-870532b3e7c7-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-ba436ded-48d7-4207-9537-870532b3e7c7-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-quobyte-ba436ded-48d7-4207-9537-870532b3e7c7" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.753s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-ba436ded-48d7-4207-9537-870532b3e7c7" acquired by "delete_volume" :: waited 0.029s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfd4c0a-873e-400b-86bf-541baee39682]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1697e-9465-463a-86bd-6e58cc2c3f61]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba436ded-48d7-4207-9537-870532b3e7c7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.492s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.9271bc0c-bbe1-456c-a431-0e6344e923d5uh3oog22.img {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba436ded-48d7-4207-9537-870532b3e7c7" returned: 0 in 0.614s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba436ded-48d7-4207-9537-870532b3e7c7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ba436ded-48d7-4207-9537-870532b3e7c7" returned: 0 in 0.586s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-ba436ded-48d7-4207-9537-870532b3e7c7" released by "delete_volume" :: held 1.555s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:44 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Created reservations ['7d8cb7fd-2221-4f2e-bf55-4aa717092b23', '00c1711a-b1e1-403e-8211-2c379f75fa65', 'b530a379-18e0-4fe9-89d7-60f9bfb57d47', 'e576bf29-bbcf-4139-bd55-9ef572f44077'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:54:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-cd66906e-ec28-44fe-a1fe-9d5262939a14-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-cd66906e-ec28-44fe-a1fe-9d5262939a14-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-quobyte-cd66906e-ec28-44fe-a1fe-9d5262939a14" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 1.498s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:47 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:54:47 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Deleted volume successfully. Sep 16 01:54:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-cd66906e-ec28-44fe-a1fe-9d5262939a14" acquired by "delete_volume" :: waited 0.197s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:47 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8202aad-018d-4955-acc1-6e68c3c17bae]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cd66906e-ec28-44fe-a1fe-9d5262939a14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f4d03d6a-b369-4d89-96d5-5312f82dda43 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-ba436ded-48d7-4207-9537-870532b3e7c7-delete_volume" released by "delete_volume" :: held 6.204s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.9271bc0c-bbe1-456c-a431-0e6344e923d5uh3oog22.img" returned: 0 in 5.399s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[586ae296-a10d-4e56-8331-7297bbc6f8a2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cd66906e-ec28-44fe-a1fe-9d5262939a14" returned: 0 in 0.939s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cd66906e-ec28-44fe-a1fe-9d5262939a14 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cd66906e-ec28-44fe-a1fe-9d5262939a14" returned: 0 in 0.134s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-cd66906e-ec28-44fe-a1fe-9d5262939a14" released by "delete_volume" :: held 1.276s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.737s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.9271bc0c-bbe1-456c-a431-0e6344e923d5uh3oog22.img {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:54:48 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Converted 1024.00 MB image at 189.29 MB/s Sep 16 01:54:48 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] 9271bc0c-bbe1-456c-a431-0e6344e923d5 was raw, no need to convert to raw {{(pid=83041) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Created reservations ['f91c66df-dd82-4a8b-9b39-a34b7c848457', '6522db7d-8b9d-4165-92db-e2daf9f6f111', 'be4be082-bb0d-4c05-a94f-0dbe561de4be', 'eab4e89d-3b2d-432a-b111-d2003b2ec357'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.208s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:54:49 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Deleted volume successfully. Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-51feb3fa-79bb-4956-9c7a-45316e5fb718-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-51feb3fa-79bb-4956-9c7a-45316e5fb718-delete_volume" acquired by "delete_volume" :: waited 0.135s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-14ac80d5-3e02-4ece-9535-076ad4f6d352 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-cd66906e-ec28-44fe-a1fe-9d5262939a14-delete_volume" released by "delete_volume" :: held 4.267s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:50 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:50 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-quobyte-51feb3fa-79bb-4956-9c7a-45316e5fb718" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:50 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-51feb3fa-79bb-4956-9c7a-45316e5fb718" acquired by "delete_volume" :: waited 0.075s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:50 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[9917c87a-476a-4259-bbbe-c81d5126cf40]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-51feb3fa-79bb-4956-9c7a-45316e5fb718 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:50 devstack quobyte-client[83066]: System call of process 97247 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:54:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-51feb3fa-79bb-4956-9c7a-45316e5fb718" returned: 0 in 0.533s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-51feb3fa-79bb-4956-9c7a-45316e5fb718 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-51feb3fa-79bb-4956-9c7a-45316e5fb718" returned: 0 in 0.147s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-51feb3fa-79bb-4956-9c7a-45316e5fb718" released by "delete_volume" :: held 0.886s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:51 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Created reservations ['2f37203e-e24b-4b85-944e-889c46393430', '715496dd-966f-4ce3-a5d1-c3f480396dd5', '11ed9948-4ed1-4acd-8fed-6a0c0c8e1800', '0baae9bc-3352-4296-8bf1-b88c571abac0'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:54:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:51 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-44e8fd27-48e2-4cd1-9143-2104745224c3-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.328s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:54:52 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Deleted volume successfully. Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-44e8fd27-48e2-4cd1-9143-2104745224c3-delete_volume" acquired by "delete_volume" :: waited 0.276s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-97a87d83-bc22-4eaf-b4ec-fb806f7c5d96 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-51feb3fa-79bb-4956-9c7a-45316e5fb718-delete_volume" released by "delete_volume" :: held 2.490s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:52 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-quobyte-44e8fd27-48e2-4cd1-9143-2104745224c3" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-44e8fd27-48e2-4cd1-9143-2104745224c3" acquired by "delete_volume" :: waited 0.037s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd87574b-6a1e-41e4-a481-9c64b3b4b373]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-44e8fd27-48e2-4cd1-9143-2104745224c3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-44e8fd27-48e2-4cd1-9143-2104745224c3" returned: 0 in 0.726s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-44e8fd27-48e2-4cd1-9143-2104745224c3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-44e8fd27-48e2-4cd1-9143-2104745224c3" returned: 0 in 0.183s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-44e8fd27-48e2-4cd1-9143-2104745224c3" released by "delete_volume" :: held 1.108s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Created reservations ['37ff811c-38b8-4a30-aa5c-a7f65e25e893', '83f6716e-30c1-48a8-b1bd-06dc2c5bb15d', 'ab7f01a6-0b96-4907-b0b0-3c9dcd31339f', '1e28e06c-62d4-4435-9fce-6083a51c6f22'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.167s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:54:54 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Deleted volume successfully. Sep 16 01:54:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e1c00a30-bcc5-41f9-8b63-9a1cb9199af8 tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-44e8fd27-48e2-4cd1-9143-2104745224c3-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-84d48c4c-0b63-4f23-a206-491e583b6830-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-84d48c4c-0b63-4f23-a206-491e583b6830-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:55 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:54:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "cinder-quobyte-84d48c4c-0b63-4f23-a206-491e583b6830" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:54:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-84d48c4c-0b63-4f23-a206-491e583b6830" acquired by "delete_volume" :: waited 0.044s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:54:55 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4729ad6e-5217-4624-8a10-a2678283fade]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:54:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-84d48c4c-0b63-4f23-a206-491e583b6830 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-84d48c4c-0b63-4f23-a206-491e583b6830" returned: 0 in 0.614s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-84d48c4c-0b63-4f23-a206-491e583b6830 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-84d48c4c-0b63-4f23-a206-491e583b6830" returned: 0 in 0.167s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-quobyte-84d48c4c-0b63-4f23-a206-491e583b6830" released by "delete_volume" :: held 1.024s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Created reservations ['a3754a42-d5ec-4071-acf9-ef31f0633477', '38d6ae07-e608-4c8f-965b-d88800742701', 'cf8feac0-aca3-422e-bbbb-16023178a7b4', 'de9c87bf-f150-4a89-947d-0598248b65f7'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.148s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:54:57 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Deleted volume successfully. Sep 16 01:54:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-66096ea3-eab4-4a0d-ad07-3f01009611be tempest-CreateVolumesFromImageTest-1956656566 None] Lock "cinder-84d48c4c-0b63-4f23-a206-491e583b6830-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.116s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:55:07 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=39,cinder:INSERT=9,cinder:UPDATE=55,cinder:DELETE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:55:07 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:INSERT=13,cinder:SELECT=37,cinder:UPDATE=51,cinder:DELETE=7 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:55:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 43.293s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:55:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Uploaded volume to glance image-id: 9271bc0c-bbe1-456c-a431-0e6344e923d5. {{(pid=83041) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 16 01:55:24 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5ae868a1-b0ce-4724-a81c-81f8a8f9bb6f tempest-VolumesActionsTest-420257601 None] Copy volume to image completed successfully. Sep 16 01:55:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c939c4e-764f-4140-929b-f6c199b13b6a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.405s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[409bc6be-14f8-4239-8e45-e1cd286f2249]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.386s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img" returned: 0 in 4.162s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:31 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d419f9-ef08-44ef-b3a8-9b5478eca091]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:55:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.514s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:31 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c, size 1024.00 MB, duration 4.18 sec, destination /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:55:31 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Converted 1024.00 MB image at 244.84 MB/s Sep 16 01:55:31 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] 0b025a8e-08ca-4d4d-8521-20f16fe625ef was raw, converting to qcow2 {{(pid=83041) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}} Sep 16 01:55:31 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f42efad-c0f0-4dac-bb19-bc7fbff77183]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:55:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img" returned: 0 in 0.336s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img" returned: 1 in 0.334s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img /opt/stack/data/cinder/conversion/vol_upload_ezbpv3_o {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img /opt/stack/data/cinder/conversion/vol_upload_ezbpv3_o" returned: 0 in 0.129s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Image conversion details: src /opt/stack/data/cinder/conversion/39a924a9-22d9-4802-9529-a0c3573a6d7c.temp_image.0b025a8e-08ca-4d4d-8521-20f16fe625efl1wogtot.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ezbpv3_o {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:55:32 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b226e3-b326-4d01-b41d-afe4ce16bcf6]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:55:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ezbpv3_o {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ezbpv3_o" returned: 0 in 0.340s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.228s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:55:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Uploaded volume to glance image-id: 0b025a8e-08ca-4d4d-8521-20f16fe625ef. {{(pid=83041) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}} Sep 16 01:55:34 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4b96ccbb-1c13-4b09-b5f8-f11dc51bbc65 tempest-VolumesActionsTest-420257601 None] Copy volume to image completed successfully. Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Acquiring lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:55:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Acquiring lock "cinder-quobyte-39a924a9-22d9-4802-9529-a0c3573a6d7c" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Lock "cinder-quobyte-39a924a9-22d9-4802-9529-a0c3573a6d7c" acquired by "delete_volume" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[674a2853-6a9d-4cbf-a5b5-5be4bd8894ac]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.374s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-39a924a9-22d9-4802-9529-a0c3573a6d7c" returned: 0 in 0.109s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Lock "cinder-quobyte-39a924a9-22d9-4802-9529-a0c3573a6d7c" released by "delete_volume" :: held 0.619s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Created reservations ['d81d99c4-3866-43c6-a16d-a3cc59d79be0', '41da6fc8-3bc8-4b59-83df-45f20a537de0', '8f2efb58-a3c1-4677-b660-6a9c1b4041f9', '9b6dd208-a4c1-4fd7-8907-01e04df2b372'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:55:37 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Deleted volume successfully. Sep 16 01:55:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ade2788-8d44-4963-9135-6542a08cae4d tempest-VolumesActionsTest-420257601 None] Lock "cinder-39a924a9-22d9-4802-9529-a0c3573a6d7c-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:55:47 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:55:47 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=8,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.127s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:56:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:56:13 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.091s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:57:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:57:35 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Flow 'volume_create_manager' (e75efbbb-4858-4d20-8e47-6f4248940aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f030ec7-cdd3-4f4d-8ad5-48324d789c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f030ec7-cdd3-4f4d-8ad5-48324d789c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2022011940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec65ea1-6674-4dca-a443-2bcad425d1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656366d0aa814bc687110d38d2c6bd7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:57:35Z,use_quota=True,user_id='d6d7108200d1483190ef122a733429fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663bd27-230e-495c-bbd1-e9912a2e71a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2663bd27-230e-495c-bbd1-e9912a2e71a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e144e473-8dc8-45e6-a7db-5cc52a09cb71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e144e473-8dc8-45e6-a7db-5cc52a09cb71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec65ea1-6674-4dca-a443-2bcad425d1ff', 'volume_name': 'volume-bec65ea1-6674-4dca-a443-2bcad425d1ff', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a4407a-c099-42fa-a5fe-1537d8bb1cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82a4407a-c099-42fa-a5fe-1537d8bb1cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5132a28b-e80d-447c-a7b6-3ed6227b8b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:57:35 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Volume bec65ea1-6674-4dca-a443-2bcad425d1ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec65ea1-6674-4dca-a443-2bcad425d1ff', 'volume_size': 1} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:57:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2022011940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec65ea1-6674-4dca-a443-2bcad425d1ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='656366d0aa814bc687110d38d2c6bd7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:57:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:57:35Z,use_quota=True,user_id='d6d7108200d1483190ef122a733429fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Creating volume bec65ea1-6674-4dca-a443-2bcad425d1ff {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:57:35 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:57:35 devstack quobyte-client[83066]: System call of process 97801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:57:35 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=122, name=volume-bec65ea1-6674-4dca-a443-2bcad425d1ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff 1073741824" returned: 0 in 0.334s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:57:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:57:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff" returned: 0 in 0.085s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:57:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] <== create_volume: return (490ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:57:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.502s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:57:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5132a28b-e80d-447c-a7b6-3ed6227b8b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec65ea1-6674-4dca-a443-2bcad425d1ff', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:57:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f830dc-12e5-43b0-8460-531ba4a69dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:57:36 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Volume volume-bec65ea1-6674-4dca-a443-2bcad425d1ff (bec65ea1-6674-4dca-a443-2bcad425d1ff): created successfully Sep 16 01:57:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f830dc-12e5-43b0-8460-531ba4a69dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:57:36 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Flow 'volume_create_manager' (e75efbbb-4858-4d20-8e47-6f4248940aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:57:36 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-c8fb06c2-d086-4662-8cac-a8c2709c54ed tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Created volume successfully. Sep 16 01:57:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6d658ae0-aba0-4c47-b194-12eef290d74b req-2aa0cf91-4e32-478a-a94e-fb94290cb901 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:57:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6d658ae0-aba0-4c47-b194-12eef290d74b req-2aa0cf91-4e32-478a-a94e-fb94290cb901 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:57:41 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c99ff6-68c3-4d45-95f1-06ada5d5380f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:57:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-6d658ae0-aba0-4c47-b194-12eef290d74b req-2aa0cf91-4e32-478a-a94e-fb94290cb901 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:57:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [req-6d658ae0-aba0-4c47-b194-12eef290d74b req-2aa0cf91-4e32-478a-a94e-fb94290cb901 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff" returned: 0 in 0.402s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:57:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [req-6d658ae0-aba0-4c47-b194-12eef290d74b req-2aa0cf91-4e32-478a-a94e-fb94290cb901 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.492s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:57:41 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-6d658ae0-aba0-4c47-b194-12eef290d74b req-2aa0cf91-4e32-478a-a94e-fb94290cb901 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862', 'name': 'volume-bec65ea1-6674-4dca-a443-2bcad425d1ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'abaec0ef-7152-47ea-ac3b-94fc605d4250', 'enforce_multipath': True} {{(pid=83041) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}} Sep 16 01:57:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-6d658ae0-aba0-4c47-b194-12eef290d74b req-2aa0cf91-4e32-478a-a94e-fb94290cb901 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:57:41 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-6d658ae0-aba0-4c47-b194-12eef290d74b req-2aa0cf91-4e32-478a-a94e-fb94290cb901 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] attachment_update completed successfully. Sep 16 01:57:51 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:57:52 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=4,cinder:SELECT=4 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.082s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:58:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-05bc40d2-6e03-494d-93ca-0f9f42849ea3 req-9bf1a94e-596c-4e94-a4f4-60b4ffa7b414 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [req-05bc40d2-6e03-494d-93ca-0f9f42849ea3 req-9bf1a94e-596c-4e94-a4f4-60b4ffa7b414 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [req-05bc40d2-6e03-494d-93ca-0f9f42849ea3 req-9bf1a94e-596c-4e94-a4f4-60b4ffa7b414 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Terminate volume connection completed successfully. Sep 16 01:58:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [req-05bc40d2-6e03-494d-93ca-0f9f42849ea3 req-9bf1a94e-596c-4e94-a4f4-60b4ffa7b414 tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Deleting attachment abaec0ef-7152-47ea-ac3b-94fc605d4250. {{(pid=83041) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}} Sep 16 01:58:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Acquiring lock "cinder-bec65ea1-6674-4dca-a443-2bcad425d1ff-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "cinder-bec65ea1-6674-4dca-a443-2bcad425d1ff-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:13 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Acquiring lock "cinder-quobyte-bec65ea1-6674-4dca-a443-2bcad425d1ff" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:13 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "cinder-quobyte-bec65ea1-6674-4dca-a443-2bcad425d1ff" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:13 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4f43ea-cea5-4f79-bc08-6ee7202efe93]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:58:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff" returned: 0 in 0.416s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bec65ea1-6674-4dca-a443-2bcad425d1ff" returned: 0 in 0.095s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "cinder-quobyte-bec65ea1-6674-4dca-a443-2bcad425d1ff" released by "delete_volume" :: held 0.644s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Created reservations ['d7e3427a-9ef5-493b-a511-0148aecb5b12', '30cdf6de-9b1a-4cb9-a851-9f13005e96c4', '4b31c924-0a92-4f29-a678-e7deb7c72c21', '4895aa98-6b73-4c1a-98c4-373dc333bb92'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.098s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:58:14 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Deleted volume successfully. Sep 16 01:58:14 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d2654a35-a3ba-4c7b-8aa9-1c47ae317b8e tempest-TestServerVolumeAttachScenarioOldVersion-539686789 None] Lock "cinder-bec65ea1-6674-4dca-a443-2bcad425d1ff-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:24 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=11,cinder:SELECT=5 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:58:24 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=8,cinder:UPDATE=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:58:37 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (07829f37-92c0-4c38-99b5-35bda61f8ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c374699-1bc5-412d-9922-bce7ae019ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c374699-1bc5-412d-9922-bce7ae019ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647638837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191b159d-3c63-4d86-a6e5-986bcf318b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:37Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51adc1e-bc33-4ebf-bc49-011347f60d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51adc1e-bc33-4ebf-bc49-011347f60d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74243e2-3353-4aef-866a-eeafd4f0eca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74243e2-3353-4aef-866a-eeafd4f0eca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191b159d-3c63-4d86-a6e5-986bcf318b85', 'volume_name': 'volume-191b159d-3c63-4d86-a6e5-986bcf318b85', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6378a2-4a96-48b6-8e74-31cf76a3fb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e6378a2-4a96-48b6-8e74-31cf76a3fb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de00d418-86ea-4f29-8961-38128ba88d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:37 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume 191b159d-3c63-4d86-a6e5-986bcf318b85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191b159d-3c63-4d86-a6e5-986bcf318b85', 'volume_size': 1} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-647638837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191b159d-3c63-4d86-a6e5-986bcf318b85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:37Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Creating volume 191b159d-3c63-4d86-a6e5-986bcf318b85 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:58:37 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:37 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=123, name=volume-191b159d-3c63-4d86-a6e5-986bcf318b85, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 1073741824" returned: 0 in 0.325s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85" returned: 0 in 0.081s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] <== create_volume: return (478ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:58:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.491s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de00d418-86ea-4f29-8961-38128ba88d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191b159d-3c63-4d86-a6e5-986bcf318b85', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82afb739-4dfe-4faf-b905-83cd43be3ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:38 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume volume-191b159d-3c63-4d86-a6e5-986bcf318b85 (191b159d-3c63-4d86-a6e5-986bcf318b85): created successfully Sep 16 01:58:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82afb739-4dfe-4faf-b905-83cd43be3ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:38 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (07829f37-92c0-4c38-99b5-35bda61f8ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-cef6a468-ca43-4e8c-a450-7c9c4a189fa6 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created volume successfully. Sep 16 01:58:39 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Creating offline snapshot 1ebf9671-abd2-47cd-b544-b07118ff8cc8 of volume 191b159d-3c63-4d86-a6e5-986bcf318b85 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:58:39 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[516dc7ad-9e06-4c7b-a862-dbfb59efddcf]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:58:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85" returned: 0 in 0.401s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:40 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=124, name=volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 1G" returned: 0 in 0.211s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img rebase -u -b volume-191b159d-3c63-4d86-a6e5-986bcf318b85 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img rebase -u -b volume-191b159d-3c63-4d86-a6e5-986bcf318b85 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8" returned: 0 in 0.126s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8" returned: 0 in 0.091s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8" returned: 0 in 0.105s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.info" returned: 0 in 0.082s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:58:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.info" returned: 0 in 0.081s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.413s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:41 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-65a01268-0612-45ef-9a20-acab4ef0cd6a tempest-CreateVolumesFromSnapshotTest-1898041674 None] Create snapshot completed successfully Sep 16 01:58:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (abbea664-de4a-4802-bb64-28911244a040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9f89ec-5d5a-4a1e-8743-2a330d09d2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a9f89ec-5d5a-4a1e-8743-2a330d09d2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-988327685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc019fc-21f5-46aa-98fb-02c9de3ca7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:42Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264f8794-7084-449f-9cdd-23268a8a9a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (264f8794-7084-449f-9cdd-23268a8a9a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a2d2e0-0b13-4b0e-8e52-17fe3d149bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7a2d2e0-0b13-4b0e-8e52-17fe3d149bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc019fc-21f5-46aa-98fb-02c9de3ca7a2', 'volume_name': 'volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49f52c5-353c-446a-964f-3db980acf401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c49f52c5-353c-446a-964f-3db980acf401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6508b23e-ba05-43b2-b825-9302f98de516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:42 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume bbc019fc-21f5-46aa-98fb-02c9de3ca7a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2', 'volume_size': 1} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-988327685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc019fc-21f5-46aa-98fb-02c9de3ca7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:42Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Creating volume bbc019fc-21f5-46aa-98fb-02c9de3ca7a2 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:58:42 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:42 devstack quobyte-client[83066]: System call of process 98363 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:58:42 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=126, name=volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:58:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:42 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (78687bc5-323b-46fe-8f21-a4b84116935f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65bfd8f5-ade1-4a9b-8f53-bba72f702f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2 1073741824" returned: 0 in 0.889s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65bfd8f5-ade1-4a9b-8f53-bba72f702f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677212958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33fcae1-062e-4a37-aca1-0f4b77d00bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:42Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fb3a83-9ec6-4fdb-96bb-2e045cc828c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fb3a83-9ec6-4fdb-96bb-2e045cc828c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4567753-d61f-40ce-9d3e-f3e41ba70d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4567753-d61f-40ce-9d3e-f3e41ba70d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a33fcae1-062e-4a37-aca1-0f4b77d00bd7', 'volume_name': 'volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ccb4d9-2a9c-43aa-bbaf-32bef3846b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ccb4d9-2a9c-43aa-bbaf-32bef3846b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fa9485-3a61-4577-abbe-5eb6b9679bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:43 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume a33fcae1-062e-4a37-aca1-0f4b77d00bd7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7', 'volume_size': 1} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2" returned: 0 in 0.651s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] <== create_volume: return (1726ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-677212958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a33fcae1-062e-4a37-aca1-0f4b77d00bd7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:42Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Creating volume a33fcae1-062e-4a37-aca1-0f4b77d00bd7 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:58:44 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:44 devstack quobyte-client[83066]: System call of process 98369 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:58:44 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=127, name=volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (8cabb662-bc9a-40a9-ac01-81f8c60bc83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39a9872-1fe4-4b1e-97a2-1bab9bdd71e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (00fcafdb-7d74-4310-bfd4-52a98bf20ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f28589-1684-4ad2-9cea-e8f0b7e3b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6508b23e-ba05-43b2-b825-9302f98de516) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3b8cc7-6aa4-4d4f-9a74-8296c63ffd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39a9872-1fe4-4b1e-97a2-1bab9bdd71e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1961742650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03ceb7a-cc9a-4a67-889b-259e2665148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:43Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac9caf3-8c63-4632-a2ba-9cc7c7ab586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ac9caf3-8c63-4632-a2ba-9cc7c7ab586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f88f6b5-ef2d-4eaa-95fd-5e3802e39fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f88f6b5-ef2d-4eaa-95fd-5e3802e39fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03ceb7a-cc9a-4a67-889b-259e2665148e', 'volume_name': 'volume-b03ceb7a-cc9a-4a67-889b-259e2665148e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c1612d-47e5-4348-8c4e-baa1de192c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7c1612d-47e5-4348-8c4e-baa1de192c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5991657-50e8-4e15-9cf5-1ec4f13ceebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume b03ceb7a-cc9a-4a67-889b-259e2665148e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03ceb7a-cc9a-4a67-889b-259e2665148e', 'volume_size': 1} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f28589-1684-4ad2-9cea-e8f0b7e3b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2026002860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e535d0e5-9746-4ec4-8a19-7476fa0619f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:43Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515cec1b-7988-4334-b9a2-8bf176ddebb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (515cec1b-7988-4334-b9a2-8bf176ddebb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b6d660-e84e-44af-a7d9-013469a01d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52b6d660-e84e-44af-a7d9-013469a01d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e535d0e5-9746-4ec4-8a19-7476fa0619f5', 'volume_name': 'volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd1bf86-e650-4865-bf8b-387df87c9c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbd1bf86-e650-4865-bf8b-387df87c9c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3620e01b-e252-4f3d-9eb6-4d1789f95902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:44 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume e535d0e5-9746-4ec4-8a19-7476fa0619f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5', 'volume_size': 1} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7 1073741824" returned: 0 in 0.762s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (e5015f99-eca3-4bd2-991c-2cc14c9678e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84350641-09d9-4a97-8c44-3fe4c91433b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84350641-09d9-4a97-8c44-3fe4c91433b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-875509403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dc5011-bc47-46fc-a2bd-80baa40d02d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:44Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ab6cf3-8ee6-48cf-bded-bf1a219d0fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ab6cf3-8ee6-48cf-bded-bf1a219d0fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6643b557-f9bf-47d5-869c-804d77f3f2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6643b557-f9bf-47d5-869c-804d77f3f2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92dc5011-bc47-46fc-a2bd-80baa40d02d5', 'volume_name': 'volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c93b98-aa2f-4a1a-bc06-3929c60282d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c93b98-aa2f-4a1a-bc06-3929c60282d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c962f514-e75f-400f-8a7d-4c000412776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:45 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume 92dc5011-bc47-46fc-a2bd-80baa40d02d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5', 'volume_size': 1} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:45 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2 (bbc019fc-21f5-46aa-98fb-02c9de3ca7a2): created successfully Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3b8cc7-6aa4-4d4f-9a74-8296c63ffd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (abbea664-de4a-4802-bb64-28911244a040) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7" returned: 0 in 0.771s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] <== create_volume: return (1561ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.841s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1961742650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03ceb7a-cc9a-4a67-889b-259e2665148e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:43Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Creating volume b03ceb7a-cc9a-4a67-889b-259e2665148e {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:58:45 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:58:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b03ceb7a-cc9a-4a67-889b-259e2665148e 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:45 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=128, name=volume-b03ceb7a-cc9a-4a67-889b-259e2665148e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:58:45 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-68c1b513-e341-45c7-80a3-6c9957e03bbd tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created volume successfully. Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30fa9485-3a61-4577-abbe-5eb6b9679bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a769d874-7b65-41cf-84c9-05051398655b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b03ceb7a-cc9a-4a67-889b-259e2665148e 1073741824" returned: 0 in 0.527s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b03ceb7a-cc9a-4a67-889b-259e2665148e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:46 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7 (a33fcae1-062e-4a37-aca1-0f4b77d00bd7): created successfully Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a769d874-7b65-41cf-84c9-05051398655b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (78687bc5-323b-46fe-8f21-a4b84116935f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b03ceb7a-cc9a-4a67-889b-259e2665148e" returned: 0 in 0.316s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] <== create_volume: return (867ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.680s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2026002860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e535d0e5-9746-4ec4-8a19-7476fa0619f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:43Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Creating volume e535d0e5-9746-4ec4-8a19-7476fa0619f5 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:58:46 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:46 devstack quobyte-client[83066]: System call of process 98410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:58:46 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=129, name=volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:58:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-a6517835-f488-4256-9257-af0d118dfe6e tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created volume successfully. Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5991657-50e8-4e15-9cf5-1ec4f13ceebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03ceb7a-cc9a-4a67-889b-259e2665148e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d4cf05-001d-4de2-b10c-3108c2225a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5 1073741824" returned: 0 in 0.408s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:47 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume volume-b03ceb7a-cc9a-4a67-889b-259e2665148e (b03ceb7a-cc9a-4a67-889b-259e2665148e): created successfully Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69d4cf05-001d-4de2-b10c-3108c2225a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (8cabb662-bc9a-40a9-ac01-81f8c60bc83c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5" returned: 0 in 0.290s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] <== create_volume: return (722ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-875509403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dc5011-bc47-46fc-a2bd-80baa40d02d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b861f5e1c8274262bbc9094a647bf72e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:58:44Z,use_quota=True,user_id='77726804f5ab4153930d66b6e5c00ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Creating volume 92dc5011-bc47-46fc-a2bd-80baa40d02d5 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:58:47 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:47 devstack quobyte-client[83066]: System call of process 98414 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:58:47 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=130, name=volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:58:47 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-545d2545-f17a-4f20-b833-a0733d6fba24 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created volume successfully. Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3620e01b-e252-4f3d-9eb6-4d1789f95902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bf322a-0787-4e3d-9588-f84376e78e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5 1073741824" returned: 0 in 0.412s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:47 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5 (e535d0e5-9746-4ec4-8a19-7476fa0619f5): created successfully Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4bf322a-0787-4e3d-9588-f84376e78e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:47 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (00fcafdb-7d74-4310-bfd4-52a98bf20ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5" returned: 0 in 0.319s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:48 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] <== create_volume: return (757ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:58:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:48 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0c364921-b3d1-40b4-acd7-6d3002fd1cc9 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created volume successfully. Sep 16 01:58:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c962f514-e75f-400f-8a7d-4c000412776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3d4174-fcb7-4328-9f3e-2b4ccd8114fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:58:48 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5 (92dc5011-bc47-46fc-a2bd-80baa40d02d5): created successfully Sep 16 01:58:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3d4174-fcb7-4328-9f3e-2b4ccd8114fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:58:48 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Flow 'volume_create_manager' (e5015f99-eca3-4bd2-991c-2cc14c9678e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:58:48 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e9cb13d4-05b1-4198-9857-ca2d916de0fe tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created volume successfully. Sep 16 01:58:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-92dc5011-bc47-46fc-a2bd-80baa40d02d5-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-92dc5011-bc47-46fc-a2bd-80baa40d02d5-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:49 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-quobyte-92dc5011-bc47-46fc-a2bd-80baa40d02d5" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-92dc5011-bc47-46fc-a2bd-80baa40d02d5" acquired by "delete_volume" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0088558c-cc09-4144-90fd-fc2b4f74437f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5" returned: 0 in 0.375s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92dc5011-bc47-46fc-a2bd-80baa40d02d5" returned: 0 in 0.100s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-92dc5011-bc47-46fc-a2bd-80baa40d02d5" released by "delete_volume" :: held 0.609s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created reservations ['c82ee406-2bdd-423e-89de-9514788b1528', '55a15678-0420-4099-a793-1224b22817dd', 'f4d10f97-0133-4dec-b92a-9f867f5aac18', 'bb458638-0787-4b6e-8ef8-aec3eeb76e70'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.100s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:58:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Deleted volume successfully. Sep 16 01:58:50 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08b185f9-a0cd-4771-90a8-05198935ecc0 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-92dc5011-bc47-46fc-a2bd-80baa40d02d5-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-e535d0e5-9746-4ec4-8a19-7476fa0619f5-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-e535d0e5-9746-4ec4-8a19-7476fa0619f5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:51 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-quobyte-e535d0e5-9746-4ec4-8a19-7476fa0619f5" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-e535d0e5-9746-4ec4-8a19-7476fa0619f5" acquired by "delete_volume" :: waited 0.014s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21eaa3a-fc4b-4cd6-bae9-412d9b91b58a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5" returned: 0 in 0.375s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e535d0e5-9746-4ec4-8a19-7476fa0619f5" returned: 0 in 0.096s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-e535d0e5-9746-4ec4-8a19-7476fa0619f5" released by "delete_volume" :: held 0.610s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created reservations ['10a14488-7e8a-43a1-b78e-d0b8d0740419', '3c10d0f9-8f33-43a3-802b-57b2295e5f17', 'd7059dec-f51d-4a41-b469-f35f44da2359', '3e5a6487-77ef-4e95-b181-5240f65513fd'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.107s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:58:52 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Deleted volume successfully. Sep 16 01:58:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-225c46ea-be92-448f-93bc-7923ae584254 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-e535d0e5-9746-4ec4-8a19-7476fa0619f5-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-b03ceb7a-cc9a-4a67-889b-259e2665148e-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-b03ceb7a-cc9a-4a67-889b-259e2665148e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:53 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-quobyte-b03ceb7a-cc9a-4a67-889b-259e2665148e" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-b03ceb7a-cc9a-4a67-889b-259e2665148e" acquired by "delete_volume" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ce5f18-2823-4ac9-9f87-6e92191ade62]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:58:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b03ceb7a-cc9a-4a67-889b-259e2665148e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b03ceb7a-cc9a-4a67-889b-259e2665148e" returned: 0 in 0.395s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b03ceb7a-cc9a-4a67-889b-259e2665148e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b03ceb7a-cc9a-4a67-889b-259e2665148e" returned: 0 in 0.094s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-b03ceb7a-cc9a-4a67-889b-259e2665148e" released by "delete_volume" :: held 0.641s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created reservations ['55cee755-a476-4fba-9002-6ee2d529f456', '82a58820-8b08-408c-8fb9-65fa75a5076c', '8fdbfbed-e504-43ce-a29c-6e3c185c9dba', 'c6cc594b-84c8-4dd5-9584-471189fd691d'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.082s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:54 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:58:54 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Deleted volume successfully. Sep 16 01:58:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-697b3918-b395-4602-8a44-4dbae8497721 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-b03ceb7a-cc9a-4a67-889b-259e2665148e-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-a33fcae1-062e-4a37-aca1-0f4b77d00bd7-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-a33fcae1-062e-4a37-aca1-0f4b77d00bd7-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:55 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-quobyte-a33fcae1-062e-4a37-aca1-0f4b77d00bd7" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:55 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-a33fcae1-062e-4a37-aca1-0f4b77d00bd7" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:55 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2787f37e-67f6-4c9b-be91-383843b7fcc9]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7" returned: 0 in 0.396s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a33fcae1-062e-4a37-aca1-0f4b77d00bd7" returned: 0 in 0.087s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-a33fcae1-062e-4a37-aca1-0f4b77d00bd7" released by "delete_volume" :: held 0.635s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created reservations ['f393b59b-1fad-434b-bfcb-f9d7c6231e8c', '5c615684-6ac7-4052-8562-b4c338951392', '90f3868b-6048-4a44-9380-af7aa725718c', 'b4d4b9ef-0f0b-43d2-8505-cb9453b16ec4'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.080s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:57 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:58:57 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Deleted volume successfully. Sep 16 01:58:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-d9a1d381-c902-401f-bff5-4f571b6bff82 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-a33fcae1-062e-4a37-aca1-0f4b77d00bd7-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:58 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-quobyte-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2" acquired by "delete_volume" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7659551a-512b-42d0-8b78-b374eed8856a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2" returned: 0 in 0.385s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2" returned: 0 in 0.108s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2" released by "delete_volume" :: held 0.627s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created reservations ['a5097919-7cdc-4db3-bb33-7c745127c3a6', '9d26d7f4-731a-4713-860a-e215cd9ef88c', 'd947f6ce-490e-4a10-b577-210529e1dfea', '2587d5ef-8ef5-4974-bae8-8561f7701014'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.107s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:58:59 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Deleted volume successfully. Sep 16 01:58:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-09a072a8-9f43-4ae7-8922-2f8ecedfa497 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-bbc019fc-21f5-46aa-98fb-02c9de3ca7a2-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-1ebf9671-abd2-47cd-b544-b07118ff8cc8-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-1ebf9671-abd2-47cd-b544-b07118ff8cc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:00 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-quobyte-191b159d-3c63-4d86-a6e5-986bcf318b85" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-191b159d-3c63-4d86-a6e5-986bcf318b85" acquired by "delete_snapshot" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-quobyte-1ebf9671-abd2-47cd-b544-b07118ff8cc8" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-1ebf9671-abd2-47cd-b544-b07118ff8cc8" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Deleting offline snapshot 1ebf9671-abd2-47cd-b544-b07118ff8cc8 of volume 191b159d-3c63-4d86-a6e5-986bcf318b85 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] snapshot_file for this snap is: volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[8774ce68-7fc6-4bdf-bfe8-3b733748bb50]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8" returned: 0 in 0.366s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-191b159d-3c63-4d86-a6e5-986bcf318b85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ac87b4-b421-4819-a64c-72503276bb07]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85" returned: 0 in 0.383s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8" returned: 0 in 0.244s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85.1ebf9671-abd2-47cd-b544-b07118ff8cc8" returned: 0 in 0.084s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-1ebf9671-abd2-47cd-b544-b07118ff8cc8" released by "_delete_snapshot" :: held 1.365s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-191b159d-3c63-4d86-a6e5-986bcf318b85" released by "delete_snapshot" :: held 1.387s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:02 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created reservations ['ad51fef0-e442-4daf-9323-9c938916af0f', '946d25c2-9d8e-401d-ac7f-620459b4335d', '6d678ef9-e6e8-4995-9f32-815a3ccc9845', '9e2f351f-ec36-42e3-95a1-54515c768dbc'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:02 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Delete snapshot completed successfully. Sep 16 01:59:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-071a1641-1a40-409f-be06-9c7e02a77a5f tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-1ebf9671-abd2-47cd-b544-b07118ff8cc8-delete_snapshot" released by "delete_snapshot" :: held 1.833s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-191b159d-3c63-4d86-a6e5-986bcf318b85-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-191b159d-3c63-4d86-a6e5-986bcf318b85-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:02 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "cinder-quobyte-191b159d-3c63-4d86-a6e5-986bcf318b85" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-191b159d-3c63-4d86-a6e5-986bcf318b85" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:02 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e359bd-8a35-46a8-8fcb-fc3f033ef718]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85" returned: 0 in 0.379s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-191b159d-3c63-4d86-a6e5-986bcf318b85" returned: 0 in 0.111s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-quobyte-191b159d-3c63-4d86-a6e5-986bcf318b85" released by "delete_volume" :: held 0.645s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Created reservations ['a326f4c9-b694-4097-a167-91c6c92021e4', '17831c8b-e2b6-4bd7-a3d7-e669299424d0', '59916cf3-cbb2-4b49-a39c-797f4f887628', 'c7057e29-32fb-4b58-8a87-2dad3b46d488'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.115s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:03 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:03 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Deleted volume successfully. Sep 16 01:59:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-9a00ca44-1fad-41b6-b079-c552eb1f1944 tempest-CreateVolumesFromSnapshotTest-1898041674 None] Lock "cinder-191b159d-3c63-4d86-a6e5-986bcf318b85-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.108s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (f2844f2a-98f5-4533-bd73-7200887ef9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abafc0e-2b83-47b5-8acf-20958aa7200d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7abafc0e-2b83-47b5-8acf-20958aa7200d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-979023183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f2107a-d362-4020-a572-f5ed1ed841b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:06Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1491265-1d85-4262-ab4c-35a6a3963b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1491265-1d85-4262-ab4c-35a6a3963b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5141fbcc-a3a1-4338-b2e3-545708b9f123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5141fbcc-a3a1-4338-b2e3-545708b9f123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89f2107a-d362-4020-a572-f5ed1ed841b8', 'volume_name': 'volume-89f2107a-d362-4020-a572-f5ed1ed841b8', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b674bfd8-814f-42ca-8580-3ea143e5940f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b674bfd8-814f-42ca-8580-3ea143e5940f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2b8101-e8ab-4cbf-a003-d4efb730884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:06 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume 89f2107a-d362-4020-a572-f5ed1ed841b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89f2107a-d362-4020-a572-f5ed1ed841b8', 'volume_size': 1} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-979023183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89f2107a-d362-4020-a572-f5ed1ed841b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:06Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Creating volume 89f2107a-d362-4020-a572-f5ed1ed841b8 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:06 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-89f2107a-d362-4020-a572-f5ed1ed841b8 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:07 devstack quobyte-client[83066]: System call of process 98463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:07 devstack quobyte-client[83066]: System call of process 98463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:07 devstack quobyte-client[83066]: System call of process 98463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:07 devstack quobyte-client[83066]: System call of process 98463 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:07 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=131, name=volume-89f2107a-d362-4020-a572-f5ed1ed841b8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-89f2107a-d362-4020-a572-f5ed1ed841b8 1073741824" returned: 0 in 0.311s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-89f2107a-d362-4020-a572-f5ed1ed841b8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-89f2107a-d362-4020-a572-f5ed1ed841b8" returned: 0 in 0.081s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] <== create_volume: return (463ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.477s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2b8101-e8ab-4cbf-a003-d4efb730884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89f2107a-d362-4020-a572-f5ed1ed841b8', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349018b3-1b5a-4295-ae3e-34cc561b3771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:07 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume volume-89f2107a-d362-4020-a572-f5ed1ed841b8 (89f2107a-d362-4020-a572-f5ed1ed841b8): created successfully Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349018b3-1b5a-4295-ae3e-34cc561b3771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (f2844f2a-98f5-4533-bd73-7200887ef9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:07 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-15ea528b-c9f8-4626-9471-0b99d6fafb29 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created volume successfully. Sep 16 01:59:09 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (a3f02d7e-c3e1-4b68-b5eb-d525c74129df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4338c5c4-de21-4e6e-9d31-1c7e6035d1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4338c5c4-de21-4e6e-9d31-1c7e6035d1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1233618805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024d436f-09e4-43c8-a544-b57340f3d813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:09Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa272aa-6419-40d9-a0bb-b97d79caaf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fa272aa-6419-40d9-a0bb-b97d79caaf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c5f1bd-5c7e-47d1-a35b-9ce5464d0f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12c5f1bd-5c7e-47d1-a35b-9ce5464d0f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024d436f-09e4-43c8-a544-b57340f3d813', 'volume_name': 'volume-024d436f-09e4-43c8-a544-b57340f3d813', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7032b0f5-d252-42f3-a6b7-59a14fef83dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7032b0f5-d252-42f3-a6b7-59a14fef83dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc5bedb-aec8-41a7-8242-459682ef0776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:09 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume 024d436f-09e4-43c8-a544-b57340f3d813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024d436f-09e4-43c8-a544-b57340f3d813', 'volume_size': 1} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1233618805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024d436f-09e4-43c8-a544-b57340f3d813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:09Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Creating volume 024d436f-09e4-43c8-a544-b57340f3d813 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:09 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-024d436f-09e4-43c8-a544-b57340f3d813 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:09 devstack quobyte-client[83066]: System call of process 98467 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:09 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=132, name=volume-024d436f-09e4-43c8-a544-b57340f3d813, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-024d436f-09e4-43c8-a544-b57340f3d813 1073741824" returned: 0 in 0.547s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-024d436f-09e4-43c8-a544-b57340f3d813 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (e244375b-6dab-4155-888f-d31f83865118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82348dbd-adcd-4831-ab7e-c1a14a28c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (a0a00445-5bbb-4662-b26b-9a7f133d1dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34baaa0f-6d25-499b-8b8b-e6be3b2704b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82348dbd-adcd-4831-ab7e-c1a14a28c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-874082073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c627dcf9-93eb-4b4c-b27a-1ebad8b183d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:09Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93eae9a-e986-419e-8f0f-d31800961df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93eae9a-e986-419e-8f0f-d31800961df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea0caec-57b3-4839-bdd6-bfe4e2b50e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea0caec-57b3-4839-bdd6-bfe4e2b50e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c627dcf9-93eb-4b4c-b27a-1ebad8b183d7', 'volume_name': 'volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fe6322-c1cc-45fd-ab7a-b412dc8a1528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fe6322-c1cc-45fd-ab7a-b412dc8a1528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bd117f-e0d0-407d-8e74-a3021100fd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume c627dcf9-93eb-4b4c-b27a-1ebad8b183d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7', 'volume_size': 1} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-024d436f-09e4-43c8-a544-b57340f3d813" returned: 0 in 0.689s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34baaa0f-6d25-499b-8b8b-e6be3b2704b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1396664238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc36e532-f1ec-4e92-a53e-cc75b1437762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:10Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20c57c7-5301-4ecb-9dc9-599df0ca1394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e20c57c7-5301-4ecb-9dc9-599df0ca1394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58f06e9-c194-49ff-9883-2e7fb6917ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b58f06e9-c194-49ff-9883-2e7fb6917ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc36e532-f1ec-4e92-a53e-cc75b1437762', 'volume_name': 'volume-cc36e532-f1ec-4e92-a53e-cc75b1437762', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a293fee-26b1-4137-af1e-60382680c13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a293fee-26b1-4137-af1e-60382680c13c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10539c20-d267-4438-851a-6b7088c0bed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume cc36e532-f1ec-4e92-a53e-cc75b1437762: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc36e532-f1ec-4e92-a53e-cc75b1437762', 'volume_size': 1} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] <== create_volume: return (1298ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (e695c7d8-8cf5-4006-ae47-7b6b0ed9b319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13e5113-fc30-4b6f-8c7e-a6930dd337cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.080s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-874082073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c627dcf9-93eb-4b4c-b27a-1ebad8b183d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:09Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Creating volume c627dcf9-93eb-4b4c-b27a-1ebad8b183d7 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:10 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:10 devstack quobyte-client[83066]: System call of process 98471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:10 devstack quobyte-client[83066]: System call of process 98471 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:10 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=133, name=volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (52dfca20-2f83-4e21-bd66-bce85015beb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da05e76c-6508-4eac-89ed-0ef629feebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da05e76c-6508-4eac-89ed-0ef629feebb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-360608888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a411abd2-d1a2-4398-9008-3c4bd276cab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:10Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef6449e-1944-4a9c-8dd0-f5b41d5c0fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef6449e-1944-4a9c-8dd0-f5b41d5c0fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c56e9b5-1088-49ca-8f61-2eff1a7714c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c56e9b5-1088-49ca-8f61-2eff1a7714c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a411abd2-d1a2-4398-9008-3c4bd276cab7', 'volume_name': 'volume-a411abd2-d1a2-4398-9008-3c4bd276cab7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040480e0-d5b9-43be-bb19-91f4484b7a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040480e0-d5b9-43be-bb19-91f4484b7a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83cbe27-15ea-4f9e-88aa-a732a1f035d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume a411abd2-d1a2-4398-9008-3c4bd276cab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a411abd2-d1a2-4398-9008-3c4bd276cab7', 'volume_size': 1} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcc5bedb-aec8-41a7-8242-459682ef0776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024d436f-09e4-43c8-a544-b57340f3d813', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e94265-d507-4753-b4a5-a31fc192e21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d13e5113-fc30-4b6f-8c7e-a6930dd337cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1926298493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4599b5a3-6c9d-4fc2-bece-a352eca247b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:10Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3066d5-bb00-4378-9235-d482da03dc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c3066d5-bb00-4378-9235-d482da03dc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901b4781-15e2-4a4c-9204-72f89ff30036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901b4781-15e2-4a4c-9204-72f89ff30036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4599b5a3-6c9d-4fc2-bece-a352eca247b6', 'volume_name': 'volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23deccf0-8f3e-438c-97d3-840fa0386d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23deccf0-8f3e-438c-97d3-840fa0386d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b687431-e974-4103-b083-813f6c7395d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume 4599b5a3-6c9d-4fc2-bece-a352eca247b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6', 'volume_size': 1} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume volume-024d436f-09e4-43c8-a544-b57340f3d813 (024d436f-09e4-43c8-a544-b57340f3d813): created successfully Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09e94265-d507-4753-b4a5-a31fc192e21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (a3f02d7e-c3e1-4b68-b5eb-d525c74129df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7 1073741824" returned: 0 in 0.649s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:11 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-85a5795a-a1ed-4eb2-8b7c-b9741abecb0e tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created volume successfully. Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7" returned: 0 in 0.284s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] <== create_volume: return (952ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1396664238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc36e532-f1ec-4e92-a53e-cc75b1437762,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:10Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Creating volume cc36e532-f1ec-4e92-a53e-cc75b1437762 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:11 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc36e532-f1ec-4e92-a53e-cc75b1437762 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:11 devstack quobyte-client[83066]: System call of process 98475 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:11 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=134, name=volume-cc36e532-f1ec-4e92-a53e-cc75b1437762, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55bd117f-e0d0-407d-8e74-a3021100fd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b75e29-8b39-4b20-8094-b18afeaa335c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc36e532-f1ec-4e92-a53e-cc75b1437762 1073741824" returned: 0 in 0.417s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc36e532-f1ec-4e92-a53e-cc75b1437762 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:12 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7 (c627dcf9-93eb-4b4c-b27a-1ebad8b183d7): created successfully Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8b75e29-8b39-4b20-8094-b18afeaa335c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (e244375b-6dab-4155-888f-d31f83865118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc36e532-f1ec-4e92-a53e-cc75b1437762" returned: 0 in 0.330s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] <== create_volume: return (773ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.235s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-360608888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a411abd2-d1a2-4398-9008-3c4bd276cab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:10Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Creating volume a411abd2-d1a2-4398-9008-3c4bd276cab7 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:12 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a411abd2-d1a2-4398-9008-3c4bd276cab7 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:12 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=135, name=volume-a411abd2-d1a2-4398-9008-3c4bd276cab7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:12 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-9075dfb9-a976-44a7-a1ed-2075300465fe tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created volume successfully. Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10539c20-d267-4438-851a-6b7088c0bed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc36e532-f1ec-4e92-a53e-cc75b1437762', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5df419-8235-4fa7-96d5-0cc82791dadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a411abd2-d1a2-4398-9008-3c4bd276cab7 1073741824" returned: 0 in 0.406s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a411abd2-d1a2-4398-9008-3c4bd276cab7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:12 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume volume-cc36e532-f1ec-4e92-a53e-cc75b1437762 (cc36e532-f1ec-4e92-a53e-cc75b1437762): created successfully Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b5df419-8235-4fa7-96d5-0cc82791dadc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (a0a00445-5bbb-4662-b26b-9a7f133d1dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:13 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-de2e63ba-55d7-4c00-b5e0-11743156a1d8 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created volume successfully. Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a411abd2-d1a2-4398-9008-3c4bd276cab7" returned: 0 in 0.349s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] <== create_volume: return (781ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.983s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1926298493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4599b5a3-6c9d-4fc2-bece-a352eca247b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc220a4879294adcbc063f3bd63a28ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:10Z,use_quota=True,user_id='b6bfe3e27373439db3def68459157d81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Creating volume 4599b5a3-6c9d-4fc2-bece-a352eca247b6 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:13 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:13 devstack quobyte-client[83066]: System call of process 98483 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:13 devstack quobyte-client[83066]: System call of process 98483 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:13 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=136, name=volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e83cbe27-15ea-4f9e-88aa-a732a1f035d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a411abd2-d1a2-4398-9008-3c4bd276cab7', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8453fef6-503c-478c-816e-2715bd9ffd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6 1073741824" returned: 0 in 0.391s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:13 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume volume-a411abd2-d1a2-4398-9008-3c4bd276cab7 (a411abd2-d1a2-4398-9008-3c4bd276cab7): created successfully Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8453fef6-503c-478c-816e-2715bd9ffd1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (52dfca20-2f83-4e21-bd66-bce85015beb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6" returned: 0 in 0.335s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] <== create_volume: return (753ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:14 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-59e0730a-4189-4ae8-b162-2a4945f703be tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created volume successfully. Sep 16 01:59:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b687431-e974-4103-b083-813f6c7395d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eadbc62-ce11-4275-ada9-b641fdb1932d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:14 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6 (4599b5a3-6c9d-4fc2-bece-a352eca247b6): created successfully Sep 16 01:59:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eadbc62-ce11-4275-ada9-b641fdb1932d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Flow 'volume_create_manager' (e695c7d8-8cf5-4006-ae47-7b6b0ed9b319) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:14 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-41900f58-9239-4e0e-9bbe-e688ffa57138 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created volume successfully. Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-4599b5a3-6c9d-4fc2-bece-a352eca247b6-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-4599b5a3-6c9d-4fc2-bece-a352eca247b6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-quobyte-4599b5a3-6c9d-4fc2-bece-a352eca247b6" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-4599b5a3-6c9d-4fc2-bece-a352eca247b6" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b200126a-deb9-4cd2-aef7-9a58d59b49a2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6" returned: 0 in 0.375s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-4599b5a3-6c9d-4fc2-bece-a352eca247b6" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-4599b5a3-6c9d-4fc2-bece-a352eca247b6" released by "delete_volume" :: held 0.627s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created reservations ['b8af1700-5802-4bb8-b904-d63e4f55aeb4', '8c59ccba-337a-45e0-80e2-735ab1081519', '4241d01e-88fd-47b8-b454-5152bcc5132a', '352a5141-79aa-4cac-8e9b-983cacd774f8'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.102s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Deleted volume successfully. Sep 16 01:59:16 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-daf422ef-7be4-4250-8a0e-74795840e76f tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-4599b5a3-6c9d-4fc2-bece-a352eca247b6-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-a411abd2-d1a2-4398-9008-3c4bd276cab7-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-a411abd2-d1a2-4398-9008-3c4bd276cab7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:17 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-quobyte-a411abd2-d1a2-4398-9008-3c4bd276cab7" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:17 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-a411abd2-d1a2-4398-9008-3c4bd276cab7" acquired by "delete_volume" :: waited 0.018s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:17 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0019a87e-b01e-4751-a12f-04507df5bb78]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a411abd2-d1a2-4398-9008-3c4bd276cab7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a411abd2-d1a2-4398-9008-3c4bd276cab7" returned: 0 in 0.375s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a411abd2-d1a2-4398-9008-3c4bd276cab7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-a411abd2-d1a2-4398-9008-3c4bd276cab7" returned: 0 in 0.121s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-a411abd2-d1a2-4398-9008-3c4bd276cab7" released by "delete_volume" :: held 0.651s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created reservations ['362ea1fe-2866-424c-9074-0bdc8e19ffca', 'f3b1c7ed-af94-42bc-96a0-1203ef128b8c', 'b0ec6f84-5b48-4416-8f72-a91bd674affe', '10e17a3a-b5a3-47c4-9b5e-7744fabc9053'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.105s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:18 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:18 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Deleted volume successfully. Sep 16 01:59:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4eb4ce91-2cd6-4e75-9740-165c11a43567 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-a411abd2-d1a2-4398-9008-3c4bd276cab7-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-cc36e532-f1ec-4e92-a53e-cc75b1437762-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-cc36e532-f1ec-4e92-a53e-cc75b1437762-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:19 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-quobyte-cc36e532-f1ec-4e92-a53e-cc75b1437762" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-cc36e532-f1ec-4e92-a53e-cc75b1437762" acquired by "delete_volume" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:19 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[097780a3-b7ba-4065-9d5e-e063d039a181]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc36e532-f1ec-4e92-a53e-cc75b1437762 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc36e532-f1ec-4e92-a53e-cc75b1437762" returned: 0 in 0.398s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc36e532-f1ec-4e92-a53e-cc75b1437762 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-cc36e532-f1ec-4e92-a53e-cc75b1437762" returned: 0 in 0.090s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-cc36e532-f1ec-4e92-a53e-cc75b1437762" released by "delete_volume" :: held 0.656s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:20 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created reservations ['afd57d6e-3dc1-4505-ad2f-73502675d601', '14410177-872a-4a06-a58f-ac07c5f0dacd', '98de8f2c-1f55-4772-9c0f-b6c8c5f0fb02', '1ec1d3d3-2b7d-4273-b73e-7111da3cf014'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.089s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:21 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Deleted volume successfully. Sep 16 01:59:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-a54b1803-34de-43e0-b769-feddc8496752 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-cc36e532-f1ec-4e92-a53e-cc75b1437762-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:22 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-quobyte-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e47a9-5ed4-4e76-bbfe-3c19b3de0d18]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7" returned: 0 in 0.392s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7" returned: 0 in 0.102s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7" released by "delete_volume" :: held 0.646s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created reservations ['66f89acf-09d8-4196-82b5-08053e636f5d', '133964c2-38ed-4e68-9c2b-c59bd0eb134b', 'cb84aa4d-8ed4-46d2-8634-1ee1a1cc541d', 'dc469728-68df-4a06-8bc0-8bf5f6a1858d'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.100s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:23 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Deleted volume successfully. Sep 16 01:59:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-ca3ca709-9469-4e03-826a-d210cbc73480 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-c627dcf9-93eb-4b4c-b27a-1ebad8b183d7-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-024d436f-09e4-43c8-a544-b57340f3d813-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-024d436f-09e4-43c8-a544-b57340f3d813-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-quobyte-024d436f-09e4-43c8-a544-b57340f3d813" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-024d436f-09e4-43c8-a544-b57340f3d813" acquired by "delete_volume" :: waited 0.010s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:24 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f9d23-be2a-4e12-87b9-fc706fc57750]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-024d436f-09e4-43c8-a544-b57340f3d813 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-024d436f-09e4-43c8-a544-b57340f3d813" returned: 0 in 0.381s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-024d436f-09e4-43c8-a544-b57340f3d813 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-024d436f-09e4-43c8-a544-b57340f3d813" returned: 0 in 0.119s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-024d436f-09e4-43c8-a544-b57340f3d813" released by "delete_volume" :: held 0.658s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created reservations ['88af7c81-d66d-42e1-9999-6e012ddde9fa', '231f6176-b4d7-468b-9b3f-99cac02ae2dc', 'e9fa1ee2-34ea-45c3-97da-582af7fadf05', '30e1b450-3529-45ca-b75e-e8de09bb375c'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.108s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:25 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Deleted volume successfully. Sep 16 01:59:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-36f3e4c9-d9c4-4a70-b6f0-2fb5c83996f3 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-024d436f-09e4-43c8-a544-b57340f3d813-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-89f2107a-d362-4020-a572-f5ed1ed841b8-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-89f2107a-d362-4020-a572-f5ed1ed841b8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "cinder-quobyte-89f2107a-d362-4020-a572-f5ed1ed841b8" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:26 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-89f2107a-d362-4020-a572-f5ed1ed841b8" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:26 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[33de3910-2606-43f8-bd05-a889c5dd3c9b]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-89f2107a-d362-4020-a572-f5ed1ed841b8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-89f2107a-d362-4020-a572-f5ed1ed841b8" returned: 0 in 0.384s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-89f2107a-d362-4020-a572-f5ed1ed841b8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-89f2107a-d362-4020-a572-f5ed1ed841b8" returned: 0 in 0.112s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-quobyte-89f2107a-d362-4020-a572-f5ed1ed841b8" released by "delete_volume" :: held 0.649s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Created reservations ['b31ed647-835d-46ee-81dd-961b0422e998', '93736d42-0209-4339-8ed6-04d713fa1e46', 'b395291d-f1a6-46a1-84b6-52f132d6d08e', '616c00e6-3e63-4a0d-8c46-149ba49cfc86'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.102s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:27 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Deleted volume successfully. Sep 16 01:59:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4ea123ee-347b-4c30-8b48-8cfe88619a22 tempest-CreateVolumesFromSourceVolumeTest-20904856 None] Lock "cinder-89f2107a-d362-4020-a572-f5ed1ed841b8-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:33 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Flow 'volume_create_manager' (00e71f1f-07cd-4a16-8980-456d95c88b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddbadb5-1726-4afb-9bb2-1faa90d7901a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddbadb5-1726-4afb-9bb2-1faa90d7901a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc26010a-a3db-4bb0-a377-b80facf32b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164a100f10fc470d976ad2a860cdf946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:33Z,use_quota=True,user_id='b2b7031ab57e45eabecd7c80430aada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb804ef8-2e29-4a63-a436-4c0c7def30be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb804ef8-2e29-4a63-a436-4c0c7def30be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d23362-5a17-4979-9da8-e41e95f31919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.image.glance [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Creating Keystone auth plugin from conf {{(pid=83041) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05d23362-5a17-4979-9da8-e41e95f31919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bc26010a-a3db-4bb0-a377-b80facf32b47', 'volume_name': 'volume-bc26010a-a3db-4bb0-a377-b80facf32b47', 'volume_size': 1, 'image_id': '84bc2dbb-1822-461b-af42-033481abf897', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84bc2dbb-1822-461b-af42-033481abf897', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88bb2e971db6c58d261d3ecb72b90626', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '164a100f10fc470d976ad2a860cdf946', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb7085b528530e6d4358930f337699746bb413a2c653b4634690cdab3ee9e52ea54f0a9952b30dfcc41da324544d673d90a1486419559121265bf00c1bce05d0', 'id': '84bc2dbb-1822-461b-af42-033481abf897', 'created_at': datetime.datetime(2025, 9, 15, 23, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 59, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84bc2dbb-1822-461b-af42-033481abf897/file', 'properties': {}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4d97d5-ecf4-456e-969a-316649143771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d4d97d5-ecf4-456e-969a-316649143771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a341b2f-c295-4b2c-8b91-8004e42011f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:33 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Volume bc26010a-a3db-4bb0-a377-b80facf32b47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bc26010a-a3db-4bb0-a377-b80facf32b47', 'volume_size': 1, 'image_id': '84bc2dbb-1822-461b-af42-033481abf897', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84bc2dbb-1822-461b-af42-033481abf897', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88bb2e971db6c58d261d3ecb72b90626', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '164a100f10fc470d976ad2a860cdf946', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb7085b528530e6d4358930f337699746bb413a2c653b4634690cdab3ee9e52ea54f0a9952b30dfcc41da324544d673d90a1486419559121265bf00c1bce05d0', 'id': '84bc2dbb-1822-461b-af42-033481abf897', 'created_at': datetime.datetime(2025, 9, 15, 23, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 59, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84bc2dbb-1822-461b-af42-033481abf897/file', 'properties': {}}, 'image_service': } Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Cloning bc26010a-a3db-4bb0-a377-b80facf32b47 from image 84bc2dbb-1822-461b-af42-033481abf897 at location (None, [{'url': 'file:///opt/stack/data/glance/images/84bc2dbb-1822-461b-af42-033481abf897', 'metadata': {}}]). {{(pid=83041) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 01:59:33 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Image download 0.00 MB at 0.00 MB/s Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b365f531-39f8-4e08-8d6e-6577682301f2]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:34 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD Sep 16 01:59:34 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:59:35 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Sep 16 01:59:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD" returned: 0 in 1.930s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:36 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD Sep 16 01:59:36 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:59:37 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 16 01:59:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD" returned: 1 in 1.869s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:59:37 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Temporary image 84bc2dbb-1822-461b-af42-033481abf897 is fetched for user b2b7031ab57e45eabecd7c80430aada8. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 01:59:37 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=76,cinder:UPDATE=137,cinder:DELETE=9,cinder:INSERT=21 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:59:37 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=84,cinder:UPDATE=117,cinder:DELETE=16,cinder:INSERT=31 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 01:59:37 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c44e44-1cd7-419c-b699-7a5ae73ccfdc]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:38 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD Sep 16 01:59:38 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:59:39 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 16 01:59:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD" returned: 0 in 1.948s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:40 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD Sep 16 01:59:40 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 01:59:41 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD" returned: 1 in 1.899s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc26010a-a3db-4bb0-a377-b80facf32b47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='164a100f10fc470d976ad2a860cdf946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:33Z,use_quota=True,user_id='b2b7031ab57e45eabecd7c80430aada8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Creating volume bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:41 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:42 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=137, name=volume-bc26010a-a3db-4bb0-a377-b80facf32b47, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 1073741824" returned: 0 in 0.276s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47" returned: 0 in 0.088s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] <== create_volume: return (460ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.492s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:42 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Attempting download of 84bc2dbb-1822-461b-af42-033481abf897 ((None, [{'url': 'file:///opt/stack/data/glance/images/84bc2dbb-1822-461b-af42-033481abf897', 'metadata': {}}])) to volume bc26010a-a3db-4bb0-a377-b80facf32b47. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 01:59:42 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb830a3f-5bf6-4394-b141-e5d7dd68f6b3]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84bc2dbb-1822-461b-af42-033481abf897_nlqmwvzk {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_84bc2dbb-1822-461b-af42-033481abf897_nlqmwvzk" returned: 0 in 0.350s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84bc2dbb-1822-461b-af42-033481abf897_nlqmwvzk {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84bc2dbb-1822-461b-af42-033481abf897_nlqmwvzk" returned: 1 in 0.368s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_84bc2dbb-1822-461b-af42-033481abf897_nlqmwvzk' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:59:43 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df30245-24f7-4b70-8897-fa15e419a655]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD" returned: 0 in 0.371s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD" returned: 1 in 0.427s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] 84bc2dbb-1822-461b-af42-033481abf897 was raw, converting to raw {{(pid=83041) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:44 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=137, name=volume-bc26010a-a3db-4bb0-a377-b80facf32b47, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47" returned: 0 in 0.191s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84bc2dbb-1822-461b-af42-033481abf897_jz00lq82devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 01:59:44 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 1G" returned: 0 in 0.173s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[412af8a9-3454-4699-bcf8-f345e28b986c]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47" returned: 0 in 0.417s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47" returned: 1 in 0.358s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Downloaded image 84bc2dbb-1822-461b-af42-033481abf897 ((None, [{'url': 'file:///opt/stack/data/glance/images/84bc2dbb-1822-461b-af42-033481abf897', 'metadata': {}}])) to volume bc26010a-a3db-4bb0-a377-b80facf32b47 successfully. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Temporary image 84bc2dbb-1822-461b-af42-033481abf897 for user b2b7031ab57e45eabecd7c80430aada8 is deleted. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Marking volume bc26010a-a3db-4bb0-a377-b80facf32b47 as bootable. {{(pid=83041) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Copying metadata from image 84bc2dbb-1822-461b-af42-033481abf897 to bc26010a-a3db-4bb0-a377-b80facf32b47. {{(pid=83041) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 01:59:45 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Creating volume glance metadata for volume bc26010a-a3db-4bb0-a377-b80facf32b47 backed by image 84bc2dbb-1822-461b-af42-033481abf897 with: {'image_id': '84bc2dbb-1822-461b-af42-033481abf897', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '88bb2e971db6c58d261d3ecb72b90626', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83041) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 01:59:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a341b2f-c295-4b2c-8b91-8004e42011f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc26010a-a3db-4bb0-a377-b80facf32b47', 'volume_size': 1, 'image_id': '84bc2dbb-1822-461b-af42-033481abf897', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/84bc2dbb-1822-461b-af42-033481abf897', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '88bb2e971db6c58d261d3ecb72b90626', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '164a100f10fc470d976ad2a860cdf946', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'bb7085b528530e6d4358930f337699746bb413a2c653b4634690cdab3ee9e52ea54f0a9952b30dfcc41da324544d673d90a1486419559121265bf00c1bce05d0', 'id': '84bc2dbb-1822-461b-af42-033481abf897', 'created_at': datetime.datetime(2025, 9, 15, 23, 59, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 15, 23, 59, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84bc2dbb-1822-461b-af42-033481abf897/file', 'properties': {}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a338dd7a-f4a8-4e3f-a920-ef0e66b23eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:46 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Volume volume-bc26010a-a3db-4bb0-a377-b80facf32b47 (bc26010a-a3db-4bb0-a377-b80facf32b47): created successfully Sep 16 01:59:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a338dd7a-f4a8-4e3f-a920-ef0e66b23eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:46 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Flow 'volume_create_manager' (00e71f1f-07cd-4a16-8980-456d95c88b25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2d359878-4735-4656-8822-1d5c10012b4f tempest-VolumeImageDependencyTests-1607968676 None] Created volume successfully. Sep 16 01:59:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Acquiring lock "cinder-bc26010a-a3db-4bb0-a377-b80facf32b47-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Lock "cinder-bc26010a-a3db-4bb0-a377-b80facf32b47-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Acquiring lock "cinder-quobyte-bc26010a-a3db-4bb0-a377-b80facf32b47" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Lock "cinder-quobyte-bc26010a-a3db-4bb0-a377-b80facf32b47" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:47 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f9be78-888e-42d5-94da-df94d283c730]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47" returned: 0 in 0.359s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47" returned: 1 in 0.385s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 01:59:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-bc26010a-a3db-4bb0-a377-b80facf32b47" returned: 0 in 0.092s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Lock "cinder-quobyte-bc26010a-a3db-4bb0-a377-b80facf32b47" released by "delete_volume" :: held 1.066s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:48 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Created reservations ['8dd9afc0-6282-49d0-9a75-ac24d54592b8', '0ec0fb1a-5bd4-488f-8ab6-f6dc7d7f983e', '37b10cf7-cd87-4a82-883d-307fcf8e6478', 'f7eae57e-60f1-412b-8bba-b716b9fd8879'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.085s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 01:59:49 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Deleted volume successfully. Sep 16 01:59:49 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6b5a5814-c747-43f9-9bd1-3e16781aaa7e tempest-VolumeImageDependencyTests-1607968676 None] Lock "cinder-bc26010a-a3db-4bb0-a377-b80facf32b47-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 01:59:52 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Flow 'volume_create_manager' (03c4b649-527a-4dc3-aff2-7e2b3bf8113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce26818-fc5c-4b92-8a51-57fefd40cd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce26818-fc5c-4b92-8a51-57fefd40cd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e28d59-ce3a-46ba-a3e2-dfa017c6a711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b393af7c93474ba12bb3146ce98bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:53Z,use_quota=True,user_id='edf5869380b3425b91a9f095ff6636e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cbd87c-468a-4ef9-97bc-945c8abb927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93cbd87c-468a-4ef9-97bc-945c8abb927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baed1259-9115-4b86-8701-84c496e276f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baed1259-9115-4b86-8701-84c496e276f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e28d59-ce3a-46ba-a3e2-dfa017c6a711', 'volume_name': 'volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d6ce5b-c389-4433-9f6c-7de61b2b4ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3d6ce5b-c389-4433-9f6c-7de61b2b4ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2eb75ee-8393-41c5-817a-f38a3f8d5814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:52 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Volume 46e28d59-ce3a-46ba-a3e2-dfa017c6a711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711', 'volume_size': 1} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e28d59-ce3a-46ba-a3e2-dfa017c6a711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b393af7c93474ba12bb3146ce98bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:53Z,use_quota=True,user_id='edf5869380b3425b91a9f095ff6636e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Creating volume 46e28d59-ce3a-46ba-a3e2-dfa017c6a711 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:52 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:53 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=138, name=volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711 1073741824" returned: 0 in 0.303s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711" returned: 0 in 0.082s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] <== create_volume: return (451ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.463s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2eb75ee-8393-41c5-817a-f38a3f8d5814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d16e2e-bb7b-4ec6-a3bc-f401adea7151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:53 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Volume volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711 (46e28d59-ce3a-46ba-a3e2-dfa017c6a711): created successfully Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57d16e2e-bb7b-4ec6-a3bc-f401adea7151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Flow 'volume_create_manager' (03c4b649-527a-4dc3-aff2-7e2b3bf8113e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:53 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1179e7eb-1b8b-4283-aff5-f264b16ef8fa tempest-CinderUnicodeTest-637929192 None] Created volume successfully. Sep 16 01:59:55 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Flow 'volume_create_manager' (3b82df78-c140-4435-bfa4-9be0ad34c3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427e4348-fd6e-42d0-862f-020e33383c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (427e4348-fd6e-42d0-862f-020e33383c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-25735422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0961f94c-4d74-4923-b13c-7a965e3bcb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b393af7c93474ba12bb3146ce98bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:55Z,use_quota=True,user_id='edf5869380b3425b91a9f095ff6636e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff9aab-ae1b-4aee-af28-2c70dae58852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11ff9aab-ae1b-4aee-af28-2c70dae58852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17798c4-ee18-481a-9904-7dfffdb0fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a17798c4-ee18-481a-9904-7dfffdb0fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0961f94c-4d74-4923-b13c-7a965e3bcb29', 'volume_name': 'volume-0961f94c-4d74-4923-b13c-7a965e3bcb29', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6c229c-5c82-4f5c-bcbd-fac3788ea4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b6c229c-5c82-4f5c-bcbd-fac3788ea4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4f2e13-001e-4057-b337-09f7279e6d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:55 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Volume 0961f94c-4d74-4923-b13c-7a965e3bcb29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0961f94c-4d74-4923-b13c-7a965e3bcb29', 'volume_size': 1} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-15T23:59:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-25735422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0961f94c-4d74-4923-b13c-7a965e3bcb29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2b393af7c93474ba12bb3146ce98bae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-15T23:59:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-15T23:59:55Z,use_quota=True,user_id='edf5869380b3425b91a9f095ff6636e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Creating volume 0961f94c-4d74-4923-b13c-7a965e3bcb29 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 01:59:55 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:55 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=139, name=volume-0961f94c-4d74-4923-b13c-7a965e3bcb29, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:55 devstack quobyte-client[83066]: System call of process 98617 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 1073741824" returned: 0 in 0.288s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29" returned: 0 in 0.082s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] <== create_volume: return (437ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 01:59:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.450s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d4f2e13-001e-4057-b337-09f7279e6d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0961f94c-4d74-4923-b13c-7a965e3bcb29', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b514067f-142c-4e65-95b4-216b5c2a14b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 01:59:56 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Volume volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 (0961f94c-4d74-4923-b13c-7a965e3bcb29): created successfully Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b514067f-142c-4e65-95b4-216b5c2a14b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Flow 'volume_create_manager' (3b82df78-c140-4435-bfa4-9be0ad34c3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 01:59:56 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0d8d90dd-9c08-4173-9214-6dca5e8d0953 tempest-CinderUnicodeTest-637929192 None] Created volume successfully. Sep 16 01:59:56 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Creating offline snapshot 64797bb3-7114-49ad-bb74-46d546135c89 of volume 0961f94c-4d74-4923-b13c-7a965e3bcb29 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cfa609-512b-46d9-87b5-d19d993a29f7]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29" returned: 0 in 0.385s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:57 devstack quobyte-client[83066]: System call of process 98625 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:57 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=140, name=volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 1G" returned: 0 in 0.214s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): qemu-img rebase -u -b volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:57 devstack quobyte-client[83066]: System call of process 98628 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] CMD "qemu-img rebase -u -b volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89" returned: 0 in 0.125s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89" returned: 0 in 0.092s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89" returned: 0 in 0.088s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.info" returned: 0 in 0.087s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 01:59:57 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.info" returned: 0 in 0.084s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.416s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 01:59:58 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2b111234-f1e7-4289-8335-8875c4fc0fcd tempest-CinderUnicodeTest-637929192 None] Create snapshot completed successfully Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "cinder-64797bb3-7114-49ad-bb74-46d546135c89-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-64797bb3-7114-49ad-bb74-46d546135c89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:58 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "cinder-quobyte-0961f94c-4d74-4923-b13c-7a965e3bcb29" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-quobyte-0961f94c-4d74-4923-b13c-7a965e3bcb29" acquired by "delete_snapshot" :: waited 0.019s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "cinder-quobyte-64797bb3-7114-49ad-bb74-46d546135c89" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-quobyte-64797bb3-7114-49ad-bb74-46d546135c89" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Deleting offline snapshot 64797bb3-7114-49ad-bb74-46d546135c89 of volume 0961f94c-4d74-4923-b13c-7a965e3bcb29 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] snapshot_file for this snap is: volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b1667-c1d7-40d0-b590-3459124bc3ea]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89" returned: 0 in 0.424s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:59 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0961f94c-4d74-4923-b13c-7a965e3bcb29(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 01:59:59 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fa3e05-cf33-43a8-a5e1-9e5db001fe38]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 01:59:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 01:59:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29" returned: 0 in 0.374s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 01:59:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89" returned: 0 in 0.199s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29.64797bb3-7114-49ad-bb74-46d546135c89" returned: 0 in 0.086s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-quobyte-64797bb3-7114-49ad-bb74-46d546135c89" released by "_delete_snapshot" :: held 1.358s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-quobyte-0961f94c-4d74-4923-b13c-7a965e3bcb29" released by "delete_snapshot" :: held 1.378s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:00 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Created reservations ['8af75be6-a70b-4e56-8538-e068c1d4ae37', '0e55c098-c600-4281-bfe3-cd0cdc82d2a1', '7c2ffa42-15d1-4793-bebe-7af9b2ff4a0a', '2f84987c-ad0e-4ccb-8d07-1992d18fb134'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:00:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Delete snapshot completed successfully. Sep 16 02:00:00 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-901ebe76-188a-41c5-ae5a-edd2d48f6617 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-64797bb3-7114-49ad-bb74-46d546135c89-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "cinder-0961f94c-4d74-4923-b13c-7a965e3bcb29-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-0961f94c-4d74-4923-b13c-7a965e3bcb29-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:01 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "cinder-quobyte-0961f94c-4d74-4923-b13c-7a965e3bcb29" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-quobyte-0961f94c-4d74-4923-b13c-7a965e3bcb29" acquired by "delete_volume" :: waited 0.009s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24d899a-3219-4b43-809e-ba3a527bcb76]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29" returned: 0 in 0.386s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-0961f94c-4d74-4923-b13c-7a965e3bcb29" returned: 0 in 0.106s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-quobyte-0961f94c-4d74-4923-b13c-7a965e3bcb29" released by "delete_volume" :: held 0.648s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Created reservations ['eb4b93fb-9917-4be9-b747-bb7db63815e6', 'b012b091-1fe3-424d-970a-afdcecd3316a', 'b69791af-d0e5-46ba-83fb-7aad35df6c0d', '0d4c2167-9955-49e2-a64a-8843582408cd'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:00:02 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Deleted volume successfully. Sep 16 02:00:02 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-29d6b94e-3c86-45cf-860a-84ec0a42eb09 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-0961f94c-4d74-4923-b13c-7a965e3bcb29-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "cinder-46e28d59-ce3a-46ba-a3e2-dfa017c6a711-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-46e28d59-ce3a-46ba-a3e2-dfa017c6a711-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:03 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:00:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "cinder-quobyte-46e28d59-ce3a-46ba-a3e2-dfa017c6a711" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:03 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-quobyte-46e28d59-ce3a-46ba-a3e2-dfa017c6a711" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:03 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[366f1e15-6922-409f-833d-553f1bf85c03]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:03 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711" returned: 0 in 0.587s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-46e28d59-ce3a-46ba-a3e2-dfa017c6a711" returned: 0 in 0.124s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-quobyte-46e28d59-ce3a-46ba-a3e2-dfa017c6a711" released by "delete_volume" :: held 0.863s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Created reservations ['49fac4f3-247b-462c-8710-dadc98a5d087', 'ca988e55-9673-4b63-9668-418fe181abf8', '8ce92dc9-7d52-4739-9427-cf23ba2ab46c', 'eb044798-493b-487a-863d-63507840b703'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.084s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:04 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:00:04 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Deleted volume successfully. Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-8ba8f544-43da-4f01-bb87-cfdd063cef26 tempest-CinderUnicodeTest-637929192 None] Lock "cinder-46e28d59-ce3a-46ba-a3e2-dfa017c6a711-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.099s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:00:14 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=33,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=3 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 02:00:14 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:INSERT=14,cinder:UPDATE=43,cinder:SELECT=27,cinder:DELETE=4 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 02:00:23 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Flow 'volume_create_manager' (540efeea-16e4-4d65-95ef-7f265e758645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc05df54-ee49-4e45-b41e-f0ba2f5d55ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc05df54-ee49-4e45-b41e-f0ba2f5d55ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-312922007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cb13dd-2330-4bfe-8726-b05e18e19853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df35c0f1d51457f9924e1c85044d6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:00:23Z,use_quota=True,user_id='af489eb485254dd2ac33e73a77191c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9358ef2-2a0f-4c10-95dd-fc69cf95b419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9358ef2-2a0f-4c10-95dd-fc69cf95b419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6d233b-13e9-4729-865e-43e7c4571a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a6d233b-13e9-4729-865e-43e7c4571a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52cb13dd-2330-4bfe-8726-b05e18e19853', 'volume_name': 'volume-52cb13dd-2330-4bfe-8726-b05e18e19853', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281e393a-b346-44f5-8fdf-b6263a231746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (281e393a-b346-44f5-8fdf-b6263a231746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376a0e7c-e8b9-4bef-b452-42a42f70db2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:23 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Volume 52cb13dd-2330-4bfe-8726-b05e18e19853: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52cb13dd-2330-4bfe-8726-b05e18e19853', 'volume_size': 1} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-312922007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52cb13dd-2330-4bfe-8726-b05e18e19853,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df35c0f1d51457f9924e1c85044d6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:00:23Z,use_quota=True,user_id='af489eb485254dd2ac33e73a77191c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Creating volume 52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:00:23 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:23 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=142, name=volume-52cb13dd-2330-4bfe-8726-b05e18e19853, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 1073741824" returned: 0 in 0.350s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853" returned: 0 in 0.102s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] <== create_volume: return (561ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:00:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.581s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (376a0e7c-e8b9-4bef-b452-42a42f70db2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52cb13dd-2330-4bfe-8726-b05e18e19853', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0675955d-65af-4cd8-a061-84fa47b33f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:24 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Volume volume-52cb13dd-2330-4bfe-8726-b05e18e19853 (52cb13dd-2330-4bfe-8726-b05e18e19853): created successfully Sep 16 02:00:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0675955d-65af-4cd8-a061-84fa47b33f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:24 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Flow 'volume_create_manager' (540efeea-16e4-4d65-95ef-7f265e758645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:00:24 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-9184860d-a94c-4bab-942a-1e7a7c830d38 tempest-SnapshotDependencyTests-2030657274 None] Created volume successfully. Sep 16 02:00:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:00:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Creating offline snapshot ebee2282-6653-4566-a302-d80116732a43 of volume 52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 02:00:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4f7d08-b257-4109-98bd-b39a6cf08231]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853" returned: 0 in 0.385s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:26 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=143, name=volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 1G" returned: 0 in 0.228s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): qemu-img rebase -u -b volume-52cb13dd-2330-4bfe-8726-b05e18e19853 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] CMD "qemu-img rebase -u -b volume-52cb13dd-2330-4bfe-8726-b05e18e19853 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43" returned: 0 in 0.118s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43" returned: 0 in 0.091s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43" returned: 0 in 0.109s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.info" returned: 0 in 0.086s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.info" returned: 0 in 0.083s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.429s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-286f6dea-e80d-40a1-b035-46818edb9880 tempest-SnapshotDependencyTests-2030657274 None] Create snapshot completed successfully Sep 16 02:00:28 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Flow 'volume_create_manager' (282e402b-3d48-43d2-a018-04a9b2481d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d46dcce-f5c5-4c8e-8b14-74a6ac1b0eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d46dcce-f5c5-4c8e-8b14-74a6ac1b0eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5445ded-86fa-48b8-baa7-2378ea2094f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df35c0f1d51457f9924e1c85044d6b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ebee2282-6653-4566-a302-d80116732a43,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:00:28Z,use_quota=True,user_id='af489eb485254dd2ac33e73a77191c9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c1557d-b705-4b5f-afc6-4f154b8fefba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73c1557d-b705-4b5f-afc6-4f154b8fefba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8069da2-afbb-4a43-965e-37b1eee6bde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8069da2-afbb-4a43-965e-37b1eee6bde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f5445ded-86fa-48b8-baa7-2378ea2094f3', 'volume_name': 'volume-f5445ded-86fa-48b8-baa7-2378ea2094f3', 'volume_size': 1, 'snapshot_id': 'ebee2282-6653-4566-a302-d80116732a43'}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521705fc-a025-4747-af42-a53c1b61531a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (521705fc-a025-4747-af42-a53c1b61531a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ce2e1f-a886-439d-a3de-63636d18c6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:28 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Volume f5445ded-86fa-48b8-baa7-2378ea2094f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f5445ded-86fa-48b8-baa7-2378ea2094f3', 'volume_size': 1, 'snapshot_id': 'ebee2282-6653-4566-a302-d80116732a43'} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-quobyte-ebee2282-6653-4566-a302-d80116732a43-f5445ded-86fa-48b8-baa7-2378ea2094f3" by "_create_volume_from_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-ebee2282-6653-4566-a302-d80116732a43-f5445ded-86fa-48b8-baa7-2378ea2094f3" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Creating volume f5445ded-86fa-48b8-baa7-2378ea2094f3 from snapshot ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-quobyte-f5445ded-86fa-48b8-baa7-2378ea2094f3" by "_copy_volume_from_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-f5445ded-86fa-48b8-baa7-2378ea2094f3" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] snapshot: ebee2282-6653-4566-a302-d80116732a43, volume: f5445ded-86fa-48b8-baa7-2378ea2094f3, {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae31b5c-4278-4ad4-9251-01bcc5d294fa]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43" returned: 0 in 0.381s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52cb13dd-2330-4bfe-8726-b05e18e19853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Creating direct copy from snapshot {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6423e4e-2292-408d-a83c-6d3c0d3e4700]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:29 devstack quobyte-client[83066]: System call of process 98680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:00:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853" returned: 0 in 0.418s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:29 devstack cinder-volume[83041]: DEBUG cinder.utils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3 not found in is_blk_device check {{(pid=83041) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 02:00:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:29 devstack quobyte-client[83066]: System call of process 98683 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:00:29 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=145, name=volume-f5445ded-86fa-48b8-baa7-2378ea2094f3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3" returned: 0 in 4.724s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[53614cb7-6509-426e-9a92-1a8f4e506863]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853" returned: 0 in 0.548s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853, size 1024.00 MB, duration 4.75 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3 {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 02:00:34 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Converted 1024.00 MB image at 215.64 MB/s Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3" returned: 0 in 0.078s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-f5445ded-86fa-48b8-baa7-2378ea2094f3" released by "_copy_volume_from_snapshot" :: held 6.509s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-ebee2282-6653-4566-a302-d80116732a43-f5445ded-86fa-48b8-baa7-2378ea2094f3" released by "_create_volume_from_snapshot" :: held 6.539s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.557s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16ce2e1f-a886-439d-a3de-63636d18c6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5445ded-86fa-48b8-baa7-2378ea2094f3', 'volume_size': 1, 'snapshot_id': 'ebee2282-6653-4566-a302-d80116732a43'}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c233b34-77dc-48e2-821f-c11a86139d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:00:35 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Volume volume-f5445ded-86fa-48b8-baa7-2378ea2094f3 (f5445ded-86fa-48b8-baa7-2378ea2094f3): created successfully Sep 16 02:00:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c233b34-77dc-48e2-821f-c11a86139d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:00:35 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Flow 'volume_create_manager' (282e402b-3d48-43d2-a018-04a9b2481d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:00:35 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-b77937c9-26ce-4b97-83f3-9021afc1be01 tempest-SnapshotDependencyTests-2030657274 None] Created volume successfully. Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-ebee2282-6653-4566-a302-d80116732a43-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-ebee2282-6653-4566-a302-d80116732a43-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-quobyte-52cb13dd-2330-4bfe-8726-b05e18e19853" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-52cb13dd-2330-4bfe-8726-b05e18e19853" acquired by "delete_snapshot" :: waited 0.008s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-quobyte-ebee2282-6653-4566-a302-d80116732a43" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-ebee2282-6653-4566-a302-d80116732a43" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Deleting offline snapshot ebee2282-6653-4566-a302-d80116732a43 of volume 52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] snapshot_file for this snap is: volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e307f3bb-bede-40e4-853f-5b59d0b19a0d]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43" returned: 0 in 0.372s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52cb13dd-2330-4bfe-8726-b05e18e19853(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[973c18a2-8667-4e4b-8a9f-71dcf57b06bc]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853" returned: 0 in 0.367s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43" returned: 0 in 0.196s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853.ebee2282-6653-4566-a302-d80116732a43" returned: 0 in 0.101s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-ebee2282-6653-4566-a302-d80116732a43" released by "_delete_snapshot" :: held 1.302s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-52cb13dd-2330-4bfe-8726-b05e18e19853" released by "delete_snapshot" :: held 1.322s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Created reservations ['55aa3def-c0bb-4d15-b5ef-b25207e868ea', 'f3a38d95-df6c-4799-8500-0234098a952e', 'a4bb0e70-3745-4551-83ad-f253fdbde074', '26037dae-a9f1-4e3c-91f2-d428cf7c0cbc'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:00:37 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Delete snapshot completed successfully. Sep 16 02:00:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-db0e4da9-e8e7-4de1-8c3b-62cdf1d8a530 tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-ebee2282-6653-4566-a302-d80116732a43-delete_snapshot" released by "delete_snapshot" :: held 1.720s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-52cb13dd-2330-4bfe-8726-b05e18e19853-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-52cb13dd-2330-4bfe-8726-b05e18e19853-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:38 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:00:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-quobyte-52cb13dd-2330-4bfe-8726-b05e18e19853" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-52cb13dd-2330-4bfe-8726-b05e18e19853" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:38 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7adff0f-22d7-489f-b93e-e0d5100348ef]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853" returned: 0 in 0.376s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-52cb13dd-2330-4bfe-8726-b05e18e19853" returned: 0 in 0.114s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-52cb13dd-2330-4bfe-8726-b05e18e19853" released by "delete_volume" :: held 0.653s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Created reservations ['aaa48037-0d3d-40e0-8321-57f7c2c60353', 'af373613-556f-46a4-a0b7-d58ad3875267', 'fffa2a26-8783-427b-8745-3b3aa58ba6e8', '3e570d40-5497-4a67-9d75-99f91ddcadda'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.087s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:00:39 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Deleted volume successfully. Sep 16 02:00:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-48feb83b-6021-402c-8d39-1464aaf4dffa tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-52cb13dd-2330-4bfe-8726-b05e18e19853-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-f5445ded-86fa-48b8-baa7-2378ea2094f3-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-f5445ded-86fa-48b8-baa7-2378ea2094f3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:40 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:00:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "cinder-quobyte-f5445ded-86fa-48b8-baa7-2378ea2094f3" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:00:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-f5445ded-86fa-48b8-baa7-2378ea2094f3" acquired by "delete_volume" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:00:40 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cbf3a0-417b-4e60-b054-922de77b2c63]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:00:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3" returned: 0 in 0.382s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-f5445ded-86fa-48b8-baa7-2378ea2094f3" returned: 0 in 0.086s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-quobyte-f5445ded-86fa-48b8-baa7-2378ea2094f3" released by "delete_volume" :: held 0.632s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Created reservations ['57d77df7-4a9a-4582-855a-ef5808c71eb8', 'ec47e046-ae3e-4814-819e-9668216c1c0b', 'a01cfb41-5b81-41fc-924d-ae95c31deb69', '31c5e6f2-2f97-4715-b5ed-6e740b9589a2'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:00:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:00:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.081s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:00:42 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:00:42 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Deleted volume successfully. Sep 16 02:00:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6c689c9a-5089-4a0a-8b5c-6ce93f4d7faa tempest-SnapshotDependencyTests-2030657274 None] Lock "cinder-f5445ded-86fa-48b8-baa7-2378ea2094f3-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:00:51 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:UPDATE=27,cinder:SELECT=18,cinder:INSERT=5,cinder:DELETE=1 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 02:00:52 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=21,cinder:UPDATE=26,cinder:DELETE=4,cinder:INSERT=7 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.223s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Flow 'volume_create_manager' (b67aca46-3f63-4a03-b9ba-16d8f20c9863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b297a9-bf8d-4156-943f-90078b948b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:10 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (4bfff07d-d698-4797-bf70-9c010ec2b8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005dfadd-e660-43ad-a6dc-3ddba71e2c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5b297a9-bf8d-4156-943f-90078b948b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d9c5e5-0a9c-40df-93cf-1c2b73f56343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb71dee5e71439dad8c2787d5566e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:10Z,use_quota=True,user_id='b8f0a88101194aca80023bfdc1110a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf7a5ce-d2ba-417e-9b51-4893064a3131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdf7a5ce-d2ba-417e-9b51-4893064a3131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366e0600-eac2-4c53-9579-55afea3c8284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (366e0600-eac2-4c53-9579-55afea3c8284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31d9c5e5-0a9c-40df-93cf-1c2b73f56343', 'volume_name': 'volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b9f7f8-c787-42d9-ac58-7ca53242c6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b9f7f8-c787-42d9-ac58-7ca53242c6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1079439e-2182-42d7-9321-bbb31ecda368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:10 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Volume 31d9c5e5-0a9c-40df-93cf-1c2b73f56343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343', 'volume_size': 1} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31d9c5e5-0a9c-40df-93cf-1c2b73f56343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb71dee5e71439dad8c2787d5566e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:10Z,use_quota=True,user_id='b8f0a88101194aca80023bfdc1110a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Creating volume 31d9c5e5-0a9c-40df-93cf-1c2b73f56343 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:10 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:11 devstack quobyte-client[83066]: System call of process 98814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005dfadd-e660-43ad-a6dc-3ddba71e2c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992657076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964a7333-c8ef-47db-98f5-5e770219caa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:10Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:11 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=146, name=volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad3b852-6640-4f33-ba51-3e14afb506e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dad3b852-6640-4f33-ba51-3e14afb506e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8634974f-74ab-467c-b347-821e55f12bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8634974f-74ab-467c-b347-821e55f12bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '964a7333-c8ef-47db-98f5-5e770219caa9', 'volume_name': 'volume-964a7333-c8ef-47db-98f5-5e770219caa9', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67ace0d-cbd3-40c5-926d-b4b4c7e33287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e67ace0d-cbd3-40c5-926d-b4b4c7e33287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db135f4-534f-4c1c-8d89-86905920dd7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume 964a7333-c8ef-47db-98f5-5e770219caa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-964a7333-c8ef-47db-98f5-5e770219caa9', 'volume_size': 1} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (9cbbd916-5480-4c59-8475-8aa6389fe32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285de498-201f-49b5-a15a-b2fd1098aac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (285de498-201f-49b5-a15a-b2fd1098aac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1023458221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188f3524-a8d5-41ea-a75e-df2c5ecd0d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:11Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff67e5c-644e-4e9e-9ef3-3598fe438fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff67e5c-644e-4e9e-9ef3-3598fe438fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec308cd2-f6d7-4506-97bd-7b1650637e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec308cd2-f6d7-4506-97bd-7b1650637e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188f3524-a8d5-41ea-a75e-df2c5ecd0d1c', 'volume_name': 'volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03c88d4-907d-4d22-ba01-4910cced18b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b03c88d4-907d-4d22-ba01-4910cced18b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d260555-6d6d-4d93-81a0-c8653ce59338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Volume 188f3524-a8d5-41ea-a75e-df2c5ecd0d1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c', 'volume_size': 1} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343 1073741824" returned: 0 in 0.711s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (aa8d42ab-f5c9-4f3f-af75-dd5ab39a0ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da68850f-6377-4045-8f15-4515fa7cf1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343" returned: 0 in 0.562s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] <== create_volume: return (1344ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.352s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da68850f-6377-4045-8f15-4515fa7cf1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705996386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca95103d-6d73-43ab-93c6-2e66ee31d8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:11Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dbc116-58d6-4591-b692-fca824a6a9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5dbc116-58d6-4591-b692-fca824a6a9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f38e1a-7bb7-4e3a-ab1c-61de01e2a0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f38e1a-7bb7-4e3a-ab1c-61de01e2a0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca95103d-6d73-43ab-93c6-2e66ee31d8bf', 'volume_name': 'volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8747da4-01db-46a2-85ed-f8d86c7b4631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8747da4-01db-46a2-85ed-f8d86c7b4631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa71031-c268-43af-b004-4922c60c2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:12 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Volume ca95103d-6d73-43ab-93c6-2e66ee31d8bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf', 'volume_size': 1} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1705996386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca95103d-6d73-43ab-93c6-2e66ee31d8bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:11Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Creating volume ca95103d-6d73-43ab-93c6-2e66ee31d8bf {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:12 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:12 devstack quobyte-client[83066]: System call of process 98818 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:12 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=147, name=volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (6ae2a88f-1f10-4e36-bf7e-1a274e56a247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1a9af8-a656-4e59-8aa8-0ed326322e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:12 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (f0936e5f-56f7-4493-9038-dd4d558d3e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bef0ff7-13c1-475d-ac63-c4d4b779dcdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1079439e-2182-42d7-9321-bbb31ecda368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721eb33c-5a8f-44cd-8d15-ab222157f028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1a9af8-a656-4e59-8aa8-0ed326322e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1905609147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e9d292-6e6f-424c-a76e-3d7699d8972e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:12Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44926dcd-885c-4083-893e-2e2d3eac417e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44926dcd-885c-4083-893e-2e2d3eac417e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf527b7a-dc72-427c-8d28-f22838ffc3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf527b7a-dc72-427c-8d28-f22838ffc3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e9d292-6e6f-424c-a76e-3d7699d8972e', 'volume_name': 'volume-03e9d292-6e6f-424c-a76e-3d7699d8972e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8ac5a5-15b1-4237-83f9-b1a7f5cfe393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c8ac5a5-15b1-4237-83f9-b1a7f5cfe393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4ce12c-449c-4873-82bf-ec4c478b421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Volume 03e9d292-6e6f-424c-a76e-3d7699d8972e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e9d292-6e6f-424c-a76e-3d7699d8972e', 'volume_size': 1} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf 1073741824" returned: 0 in 0.724s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bef0ff7-13c1-475d-ac63-c4d4b779dcdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118781194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b700dfd7-5563-431b-bac5-16d422be9595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:12Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef780f6e-67e0-4986-9333-92a8155cc341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef780f6e-67e0-4986-9333-92a8155cc341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcefc242-6b2e-4b89-98de-a9941c6c955e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcefc242-6b2e-4b89-98de-a9941c6c955e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b700dfd7-5563-431b-bac5-16d422be9595', 'volume_name': 'volume-b700dfd7-5563-431b-bac5-16d422be9595', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9e5d81-4ed0-4318-a9f0-1f67f7f07ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a9e5d81-4ed0-4318-a9f0-1f67f7f07ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67377cd-73a2-4549-b76b-0e4d6192e4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Volume b700dfd7-5563-431b-bac5-16d422be9595: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b700dfd7-5563-431b-bac5-16d422be9595', 'volume_size': 1} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:13 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Volume volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343 (31d9c5e5-0a9c-40df-93cf-1c2b73f56343): created successfully Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721eb33c-5a8f-44cd-8d15-ab222157f028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Flow 'volume_create_manager' (b67aca46-3f63-4a03-b9ba-16d8f20c9863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:13 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (710f7e40-3ddf-4a4f-90e6-696e0d358ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c1197b-0f45-4137-8ad8-34b40110b06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf" returned: 0 in 0.484s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] <== create_volume: return (1261ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.961s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1023458221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188f3524-a8d5-41ea-a75e-df2c5ecd0d1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:11Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Creating volume 188f3524-a8d5-41ea-a75e-df2c5ecd0d1c {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:13 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:13 devstack quobyte-client[83066]: System call of process 98822 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:13 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=148, name=volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:13 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-73a3bdfb-744e-4165-b44e-aea2cc584744 tempest-CinderUnicodeTest-1980900661 None] Created volume successfully. Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35c1197b-0f45-4137-8ad8-34b40110b06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410020829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daf7942-0b56-4aa8-adb3-b4d8a4355e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:12Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e59714-ada8-4f6a-becb-ecccc946a747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37e59714-ada8-4f6a-becb-ecccc946a747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d9ff71-75bd-4ebd-b730-0120d8a37cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5d9ff71-75bd-4ebd-b730-0120d8a37cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5daf7942-0b56-4aa8-adb3-b4d8a4355e59', 'volume_name': 'volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22848aa6-45f7-4ffa-a735-e8d655b997e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22848aa6-45f7-4ffa-a735-e8d655b997e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a02569-565c-45b7-86e7-ac97d091f280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:14 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Volume 5daf7942-0b56-4aa8-adb3-b4d8a4355e59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59', 'volume_size': 1} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa71031-c268-43af-b004-4922c60c2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d455c09-0314-4a54-a374-9d176d1ae010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c 1073741824" returned: 0 in 0.510s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c" returned: 0 in 0.138s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] <== create_volume: return (691ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.100s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-992657076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964a7333-c8ef-47db-98f5-5e770219caa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:10Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Creating volume 964a7333-c8ef-47db-98f5-5e770219caa9 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:14 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:14 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=149, name=volume-964a7333-c8ef-47db-98f5-5e770219caa9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:14 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Volume volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf (ca95103d-6d73-43ab-93c6-2e66ee31d8bf): created successfully Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d455c09-0314-4a54-a374-9d176d1ae010) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (aa8d42ab-f5c9-4f3f-af75-dd5ab39a0ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d260555-6d6d-4d93-81a0-c8653ce59338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56aedaab-0b86-4a0a-ba03-08ca40dfed28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:15 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ea1c6cda-700a-4f8a-81b7-9a8e851c97d2 tempest-CreateVolumesFromImageTest-1170534153 None] Created volume successfully. Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 1073741824" returned: 0 in 0.590s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:15 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Volume volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c (188f3524-a8d5-41ea-a75e-df2c5ecd0d1c): created successfully Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56aedaab-0b86-4a0a-ba03-08ca40dfed28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (9cbbd916-5480-4c59-8475-8aa6389fe32a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:15 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Flow 'volume_create_manager' (2226d06c-203f-443f-a4a3-05d524be4a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90f6152-e81f-475a-af6b-62b2a3049d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9" returned: 0 in 0.473s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] <== create_volume: return (1089ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.464s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1905609147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e9d292-6e6f-424c-a76e-3d7699d8972e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:12Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Creating volume 03e9d292-6e6f-424c-a76e-3d7699d8972e {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:15 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-03e9d292-6e6f-424c-a76e-3d7699d8972e 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:15 devstack quobyte-client[83066]: System call of process 98830 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:15 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=150, name=volume-03e9d292-6e6f-424c-a76e-3d7699d8972e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90f6152-e81f-475a-af6b-62b2a3049d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-878592572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c70041-6a28-480f-b227-cee447077ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb71dee5e71439dad8c2787d5566e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:15Z,use_quota=True,user_id='b8f0a88101194aca80023bfdc1110a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e78cd8-7c64-4f20-acc9-be357bd6a479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3e78cd8-7c64-4f20-acc9-be357bd6a479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ca0881-804b-4fb3-a07f-e89dc0456195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66ca0881-804b-4fb3-a07f-e89dc0456195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c70041-6a28-480f-b227-cee447077ea9', 'volume_name': 'volume-d1c70041-6a28-480f-b227-cee447077ea9', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f96fa3-4ec4-4985-9e07-ec6cc9529e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55f96fa3-4ec4-4985-9e07-ec6cc9529e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48a945a-0315-4d13-8171-8e4c61935ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:15 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Volume d1c70041-6a28-480f-b227-cee447077ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c70041-6a28-480f-b227-cee447077ea9', 'volume_size': 1} Sep 16 02:01:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:15 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-05bd02ad-5cf9-44f7-8b66-5932ac81bd86 tempest-CreateVolumesFromImageTest-1170534153 None] Created volume successfully. Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7db135f4-534f-4c1c-8d89-86905920dd7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-964a7333-c8ef-47db-98f5-5e770219caa9', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c460ac-893a-4f9a-83bc-f81685f4a252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-03e9d292-6e6f-424c-a76e-3d7699d8972e 1073741824" returned: 0 in 0.519s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-03e9d292-6e6f-424c-a76e-3d7699d8972e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:16 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume volume-964a7333-c8ef-47db-98f5-5e770219caa9 (964a7333-c8ef-47db-98f5-5e770219caa9): created successfully Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96c460ac-893a-4f9a-83bc-f81685f4a252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (4bfff07d-d698-4797-bf70-9c010ec2b8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-03e9d292-6e6f-424c-a76e-3d7699d8972e" returned: 0 in 0.284s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] <== create_volume: return (822ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.046s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-118781194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b700dfd7-5563-431b-bac5-16d422be9595,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:12Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Creating volume b700dfd7-5563-431b-bac5-16d422be9595 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:16 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b700dfd7-5563-431b-bac5-16d422be9595 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:16 devstack quobyte-client[83066]: System call of process 98835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:16 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=151, name=volume-b700dfd7-5563-431b-bac5-16d422be9595, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:16 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-05354540-012d-416b-a874-b4241892b658 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created volume successfully. Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c4ce12c-449c-4873-82bf-ec4c478b421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e9d292-6e6f-424c-a76e-3d7699d8972e', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed7fd83-1786-4842-a7f9-104ded739aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:16 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Volume volume-03e9d292-6e6f-424c-a76e-3d7699d8972e (03e9d292-6e6f-424c-a76e-3d7699d8972e): created successfully Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eed7fd83-1786-4842-a7f9-104ded739aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (6ae2a88f-1f10-4e36-bf7e-1a274e56a247) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b700dfd7-5563-431b-bac5-16d422be9595 1073741824" returned: 0 in 0.433s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b700dfd7-5563-431b-bac5-16d422be9595 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b700dfd7-5563-431b-bac5-16d422be9595" returned: 0 in 0.127s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] <== create_volume: return (603ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.623s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.992s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1410020829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5daf7942-0b56-4aa8-adb3-b4d8a4355e59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1ce65f0981443f9dd9f00568514079',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:12Z,use_quota=True,user_id='e013e9183df5491d979011316f9c489c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Creating volume 5daf7942-0b56-4aa8-adb3-b4d8a4355e59 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:17 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:17 devstack quobyte-client[83066]: System call of process 98839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:17 devstack quobyte-client[83066]: System call of process 98839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:17 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=152, name=volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:17 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d8a6564b-774d-46e5-832a-5b4383e0e0e5 tempest-CreateVolumesFromImageTest-1170534153 None] Created volume successfully. Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67377cd-73a2-4549-b76b-0e4d6192e4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b700dfd7-5563-431b-bac5-16d422be9595', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa64eef-f71a-4525-a00a-ab06cee30186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:17 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Volume volume-b700dfd7-5563-431b-bac5-16d422be9595 (b700dfd7-5563-431b-bac5-16d422be9595): created successfully Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfa64eef-f71a-4525-a00a-ab06cee30186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (f0936e5f-56f7-4493-9038-dd4d558d3e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59 1073741824" returned: 0 in 0.533s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:17 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-0b56b21e-82c3-49ad-a794-793cf7a9d8da tempest-CreateVolumesFromImageTest-1170534153 None] Created volume successfully. Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59" returned: 0 in 0.367s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] <== create_volume: return (931ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.139s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-878592572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1c70041-6a28-480f-b227-cee447077ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ccb71dee5e71439dad8c2787d5566e19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:15Z,use_quota=True,user_id='b8f0a88101194aca80023bfdc1110a75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Creating volume d1c70041-6a28-480f-b227-cee447077ea9 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:18 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:18 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:18 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=153, name=volume-d1c70041-6a28-480f-b227-cee447077ea9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a02569-565c-45b7-86e7-ac97d091f280) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5153fa5-03e2-4b19-8d7d-2563575f6347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 1073741824" returned: 0 in 0.416s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:18 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Volume volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59 (5daf7942-0b56-4aa8-adb3-b4d8a4355e59): created successfully Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5153fa5-03e2-4b19-8d7d-2563575f6347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Flow 'volume_create_manager' (710f7e40-3ddf-4a4f-90e6-696e0d358ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9" returned: 0 in 0.328s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] <== create_volume: return (766ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.624s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:18 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-acc57d78-93a1-4f67-9c6a-3f733d37bc10 tempest-CreateVolumesFromImageTest-1170534153 None] Created volume successfully. Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d48a945a-0315-4d13-8171-8e4c61935ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c70041-6a28-480f-b227-cee447077ea9', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f19decc-de12-4192-af62-960ca93a2533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Creating offline snapshot f6ccf35d-ff0a-430e-a825-4d2f3d7b393b of volume 964a7333-c8ef-47db-98f5-5e770219caa9 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17fca27-9700-4179-955b-c2fc020b37d1]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:19 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Volume volume-d1c70041-6a28-480f-b227-cee447077ea9 (d1c70041-6a28-480f-b227-cee447077ea9): created successfully Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f19decc-de12-4192-af62-960ca93a2533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Flow 'volume_create_manager' (2226d06c-203f-443f-a4a3-05d524be4a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:19 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-aae4e40a-794d-49d4-ba5f-399c814be5d2 tempest-CinderUnicodeTest-1980900661 None] Created volume successfully. Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9" returned: 0 in 0.559s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:19 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=154, name=volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-5daf7942-0b56-4aa8-adb3-b4d8a4355e59-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b 1G" returned: 0 in 0.371s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img rebase -u -b volume-964a7333-c8ef-47db-98f5-5e770219caa9 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-5daf7942-0b56-4aa8-adb3-b4d8a4355e59-delete_volume" acquired by "delete_volume" :: waited 0.227s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img rebase -u -b volume-964a7333-c8ef-47db-98f5-5e770219caa9 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" returned: 0 in 0.435s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:01:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" returned: 0 in 0.401s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:20 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-quobyte-5daf7942-0b56-4aa8-adb3-b4d8a4355e59" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 02:01:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:21 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" returned: 0 in 0.256s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-5daf7942-0b56-4aa8-adb3-b4d8a4355e59" acquired by "delete_volume" :: waited 0.441s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b200b9ed-88ae-4646-8e7b-112660cc3d49]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.info" returned: 0 in 0.257s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.info" returned: 0 in 0.135s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.807s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.655s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Creating offline snapshot cab7e579-0bf8-4ddd-a706-8fcc957e0c7c of volume d1c70041-6a28-480f-b227-cee447077ea9 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59" returned: 0 in 0.635s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee1141a-e38f-43cd-98c1-3d1c2b8e4c9f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:22 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6a163b78-e718-4ef0-9c0e-e3ed11a11b12 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Create snapshot completed successfully Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-5daf7942-0b56-4aa8-adb3-b4d8a4355e59" returned: 0 in 0.398s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-5daf7942-0b56-4aa8-adb3-b4d8a4355e59" released by "delete_volume" :: held 1.233s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Created reservations ['22827924-8d94-482f-8739-8c547beb44e8', 'a1efaaa3-544c-4191-adb8-532189b582a3', 'd7e98550-aa9a-42ec-abf0-ccc8ba82ba8c', 'dba34995-c7b9-454f-9c61-afe34a299b61'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9" returned: 0 in 0.587s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:22 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=156, name=volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c 1G" returned: 0 in 0.289s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d1c70041-6a28-480f-b227-cee447077ea9 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:23 devstack quobyte-client[83066]: System call of process 98870 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-b700dfd7-5563-431b-bac5-16d422be9595-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] CMD "qemu-img rebase -u -b volume-d1c70041-6a28-480f-b227-cee447077ea9 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" returned: 0 in 0.546s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:23 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:01:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-b700dfd7-5563-431b-bac5-16d422be9595-delete_volume" acquired by "delete_volume" :: waited 0.902s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" returned: 0 in 0.887s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:24 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-quobyte-b700dfd7-5563-431b-bac5-16d422be9595" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.958s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (0bbfedf6-999c-4618-974e-505a115cee79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6945f4-cf08-4ec9-bdb1-c020b34f9145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (110767ea-fb06-4a3c-9296-3849262624eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ee331e-b383-4372-9def-d474158c9fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (4a534cea-20a6-4b5d-be38-54ca9afbc29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3427124e-08cc-4104-9608-9d89a57c6aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Deleted volume successfully. Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" returned: 0 in 0.768s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3427124e-08cc-4104-9608-9d89a57c6aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327445212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fefc7d-6c43-4682-929b-425b137e5641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:25Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08940a11-609f-4299-a9fd-6a39d24f3d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08940a11-609f-4299-a9fd-6a39d24f3d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b918d152-8e48-414d-9098-81cffe1fee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b918d152-8e48-414d-9098-81cffe1fee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fefc7d-6c43-4682-929b-425b137e5641', 'volume_name': 'volume-92fefc7d-6c43-4682-929b-425b137e5641', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b313f2-0bf3-4206-9c2e-bd537e64d496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b313f2-0bf3-4206-9c2e-bd537e64d496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2909cd-c8b3-4c20-b02c-55f4e4f84a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume 92fefc7d-6c43-4682-929b-425b137e5641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fefc7d-6c43-4682-929b-425b137e5641', 'volume_size': 1} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:25 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (9206158d-804d-45dc-9be5-b8501a57ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0499b7dc-7718-48ab-b509-1c8131a1f4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0499b7dc-7718-48ab-b509-1c8131a1f4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799195122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02240e58-d0db-4918-86f3-bcda5fbe89a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:24Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ba0f26-e586-48fa-b556-98dbb35e9256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85ba0f26-e586-48fa-b556-98dbb35e9256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902e0e74-0839-47eb-9c0f-1f956df7d3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (902e0e74-0839-47eb-9c0f-1f956df7d3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02240e58-d0db-4918-86f3-bcda5fbe89a3', 'volume_name': 'volume-02240e58-d0db-4918-86f3-bcda5fbe89a3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5fed2a-db0e-431b-8129-660fab44d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5fed2a-db0e-431b-8129-660fab44d002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed5f508-3226-4549-b043-e51d47bcc811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume 02240e58-d0db-4918-86f3-bcda5fbe89a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02240e58-d0db-4918-86f3-bcda5fbe89a3', 'volume_size': 1} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-b700dfd7-5563-431b-bac5-16d422be9595" acquired by "delete_volume" :: waited 0.752s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06ee331e-b383-4372-9def-d474158c9fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358370913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff463e8-b45c-4db3-a64e-f0315febc344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:24Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6c8e45-f44e-40db-9e0f-76d1c53b1f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f6c8e45-f44e-40db-9e0f-76d1c53b1f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160a0199-b2e7-4632-869a-238337abe9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (160a0199-b2e7-4632-869a-238337abe9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff463e8-b45c-4db3-a64e-f0315febc344', 'volume_name': 'volume-1ff463e8-b45c-4db3-a64e-f0315febc344', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bb757d-e89f-4834-b29f-01b2b08c31e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74bb757d-e89f-4834-b29f-01b2b08c31e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299d2b9d-0e8a-43e9-a352-4f43ab887a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume 1ff463e8-b45c-4db3-a64e-f0315febc344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff463e8-b45c-4db3-a64e-f0315febc344', 'volume_size': 1} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6945f4-cf08-4ec9-bdb1-c020b34f9145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902537095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6654546-e839-4047-a5f0-6f467c314c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:24Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e29e8e-b60d-4ffc-9a1f-c8ae666b0f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75e29e8e-b60d-4ffc-9a1f-c8ae666b0f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2896548-0229-4b25-934f-cf4e7e66f25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2896548-0229-4b25-934f-cf4e7e66f25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6654546-e839-4047-a5f0-6f467c314c03', 'volume_name': 'volume-e6654546-e839-4047-a5f0-6f467c314c03', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5760f650-89fb-472c-aa20-4d2f12453a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5760f650-89fb-472c-aa20-4d2f12453a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1407675-12ea-484d-95e2-f890bf2bf583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:25 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume e6654546-e839-4047-a5f0-6f467c314c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6654546-e839-4047-a5f0-6f467c314c03', 'volume_size': 1} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecf29d4-acfe-4b0c-b35d-387d5d05c6d5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b700dfd7-5563-431b-bac5-16d422be9595 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.info" returned: 0 in 0.665s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:26 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (3270c8c5-99a9-49c7-84ca-947b60adbc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745587d3-aeb6-41e5-98d5-0e18143467eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745587d3-aeb6-41e5-98d5-0e18143467eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1382937395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:25Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf18248-22fd-4095-9a5d-e2d84d6b15d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf18248-22fd-4095-9a5d-e2d84d6b15d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822766d9-5306-43cc-80ca-e8d3c0c57b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822766d9-5306-43cc-80ca-e8d3c0c57b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1', 'volume_name': 'volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57ad707-0b64-4214-8105-4446fe16ef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57ad707-0b64-4214-8105-4446fe16ef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be6d226-c701-42b4-b652-11e7ff228fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:26 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1', 'volume_size': 1} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.info" returned: 0 in 0.560s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.985s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.498s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1327445212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fefc7d-6c43-4682-929b-425b137e5641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:25Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Creating volume 92fefc7d-6c43-4682-929b-425b137e5641 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:26 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92fefc7d-6c43-4682-929b-425b137e5641 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b700dfd7-5563-431b-bac5-16d422be9595" returned: 0 in 1.059s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:26 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=158, name=volume-92fefc7d-6c43-4682-929b-425b137e5641, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b700dfd7-5563-431b-bac5-16d422be9595 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-224a8785-8731-4faa-9833-66ff190bf7d8 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-5daf7942-0b56-4aa8-adb3-b4d8a4355e59-delete_volume" released by "delete_volume" :: held 7.207s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-b700dfd7-5563-431b-bac5-16d422be9595" returned: 0 in 0.403s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92fefc7d-6c43-4682-929b-425b137e5641 1073741824" returned: 0 in 0.590s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-b700dfd7-5563-431b-bac5-16d422be9595" released by "delete_volume" :: held 1.745s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92fefc7d-6c43-4682-929b-425b137e5641 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1c494774-9390-436d-b702-7f073ca5c3f2 tempest-CinderUnicodeTest-1980900661 None] Create snapshot completed successfully Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92fefc7d-6c43-4682-929b-425b137e5641" returned: 0 in 0.362s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] <== create_volume: return (1042ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.241s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799195122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02240e58-d0db-4918-86f3-bcda5fbe89a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:24Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Creating volume 02240e58-d0db-4918-86f3-bcda5fbe89a3 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:27 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02240e58-d0db-4918-86f3-bcda5fbe89a3 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:28 devstack quobyte-client[83066]: System call of process 98890 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:28 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=159, name=volume-02240e58-d0db-4918-86f3-bcda5fbe89a3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "cinder-cab7e579-0bf8-4ddd-a706-8fcc957e0c7c-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2909cd-c8b3-4c20-b02c-55f4e4f84a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fefc7d-6c43-4682-929b-425b137e5641', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a29a4e8-d2b7-4f49-9021-4deb2310d031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:28 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume volume-92fefc7d-6c43-4682-929b-425b137e5641 (92fefc7d-6c43-4682-929b-425b137e5641): created successfully Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a29a4e8-d2b7-4f49-9021-4deb2310d031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (4a534cea-20a6-4b5d-be38-54ca9afbc29f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-cab7e579-0bf8-4ddd-a706-8fcc957e0c7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.319s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:28 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "cinder-quobyte-d1c70041-6a28-480f-b227-cee447077ea9" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02240e58-d0db-4918-86f3-bcda5fbe89a3 1073741824" returned: 0 in 0.633s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02240e58-d0db-4918-86f3-bcda5fbe89a3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-deac0e00-4134-4720-ad19-5aac0205e8a4 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created volume successfully. Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Created reservations ['21bf6c08-846c-4f1e-a03c-9919d5ef3880', 'f8a8da08-7561-4a65-bfb7-490126ced760', 'fe95775c-4f4c-4301-a28a-c8359828a5b0', 'b051e435-77bc-43df-be26-aca6a611b30f'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-quobyte-d1c70041-6a28-480f-b227-cee447077ea9" acquired by "delete_snapshot" :: waited 0.428s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "cinder-quobyte-cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02240e58-d0db-4918-86f3-bcda5fbe89a3" returned: 0 in 0.441s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] <== create_volume: return (1102ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.273s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1358370913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff463e8-b45c-4db3-a64e-f0315febc344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:24Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Creating volume 1ff463e8-b45c-4db3-a64e-f0315febc344 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:29 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1ff463e8-b45c-4db3-a64e-f0315febc344 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:29 devstack quobyte-client[83066]: System call of process 98896 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:29 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=160, name=volume-1ff463e8-b45c-4db3-a64e-f0315febc344, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-quobyte-cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" acquired by "_delete_snapshot" :: waited 0.422s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Deleting offline snapshot cab7e579-0bf8-4ddd-a706-8fcc957e0c7c of volume d1c70041-6a28-480f-b227-cee447077ea9 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] snapshot_file for this snap is: volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbd4c75-ba98-44a6-8bd2-a01ef17dad48]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fed5f508-3226-4549-b043-e51d47bcc811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02240e58-d0db-4918-86f3-bcda5fbe89a3', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2ce396-ff47-4e51-94bf-8e3a8630459c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:29 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume volume-02240e58-d0db-4918-86f3-bcda5fbe89a3 (02240e58-d0db-4918-86f3-bcda5fbe89a3): created successfully Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2ce396-ff47-4e51-94bf-8e3a8630459c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (9206158d-804d-45dc-9be5-b8501a57ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1ff463e8-b45c-4db3-a64e-f0315febc344 1073741824" returned: 0 in 1.043s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1ff463e8-b45c-4db3-a64e-f0315febc344 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:30 devstack quobyte-client[83066]: System call of process 98899 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-03e9d292-6e6f-424c-a76e-3d7699d8972e-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:30 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3451bac8-cd2c-4343-a8d9-e72bb4fb7a82 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created volume successfully. Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" returned: 0 in 0.973s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1ff463e8-b45c-4db3-a64e-f0315febc344" returned: 0 in 0.430s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1c70041-6a28-480f-b227-cee447077ea9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] <== create_volume: return (1548ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-03e9d292-6e6f-424c-a76e-3d7699d8972e-delete_volume" acquired by "delete_volume" :: waited 0.339s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef4a2e6-57ea-47aa-8f79-67bbf490e3ba]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.834s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1902537095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6654546-e839-4047-a5f0-6f467c314c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:24Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Creating volume e6654546-e839-4047-a5f0-6f467c314c03 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:30 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6654546-e839-4047-a5f0-6f467c314c03 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:30 devstack quobyte-client[83066]: System call of process 98903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:30 devstack quobyte-client[83066]: System call of process 98903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:30 devstack quobyte-client[83066]: System call of process 98903 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:30 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=161, name=volume-e6654546-e839-4047-a5f0-6f467c314c03, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (299d2b9d-0e8a-43e9-a352-4f43ab887a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff463e8-b45c-4db3-a64e-f0315febc344', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61058448-424c-44b5-a46a-2715a7839530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:31 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume volume-1ff463e8-b45c-4db3-a64e-f0315febc344 (1ff463e8-b45c-4db3-a64e-f0315febc344): created successfully Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61058448-424c-44b5-a46a-2715a7839530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (110767ea-fb06-4a3c-9296-3849262624eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6654546-e839-4047-a5f0-6f467c314c03 1073741824" returned: 0 in 0.655s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6654546-e839-4047-a5f0-6f467c314c03 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:31 devstack quobyte-client[83066]: System call of process 98905 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:31 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-quobyte-03e9d292-6e6f-424c-a76e-3d7699d8972e" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:31 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2635720c-2996-40d2-b4b7-25e2ead95ec0 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created volume successfully. Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6654546-e839-4047-a5f0-6f467c314c03" returned: 0 in 0.805s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] <== create_volume: return (1481ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9" returned: 0 in 1.460s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.456s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1382937395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c394a2897ae4c51bc71936e67ad83b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:25Z,use_quota=True,user_id='fb938736c549414194eca00f2a06b675',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Creating volume d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:01:32 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:32 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=162, name=volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:32 devstack quobyte-client[83066]: System call of process 98920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:32 devstack quobyte-client[83066]: System call of process 98920 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-03e9d292-6e6f-424c-a76e-3d7699d8972e" acquired by "delete_volume" :: waited 0.812s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a09f671-fe4c-462c-aaa9-f0b2504e0491]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.906s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-03e9d292-6e6f-424c-a76e-3d7699d8972e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:32 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:32 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Deleted volume successfully. Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1407675-12ea-484d-95e2-f890bf2bf583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6654546-e839-4047-a5f0-6f467c314c03', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13ba5c7-1bce-4d09-bd98-dfa29807593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1 1073741824" returned: 0 in 0.988s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" returned: 0 in 0.968s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:33 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume volume-e6654546-e839-4047-a5f0-6f467c314c03 (e6654546-e839-4047-a5f0-6f467c314c03): created successfully Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b13ba5c7-1bce-4d09-bd98-dfa29807593e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (0bbfedf6-999c-4618-974e-505a115cee79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-7dacc89a-f5da-4318-9260-f37ac8bc7229 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-b700dfd7-5563-431b-bac5-16d422be9595-delete_volume" released by "delete_volume" :: held 9.307s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:33 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-7e84ca2e-db92-4ef4-9c95-3c528855f626 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created volume successfully. Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1" returned: 0 in 0.661s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] <== create_volume: return (1683ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-03e9d292-6e6f-424c-a76e-3d7699d8972e" returned: 0 in 1.208s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9.cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" returned: 0 in 0.356s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-03e9d292-6e6f-424c-a76e-3d7699d8972e {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7be6d226-c701-42b4-b652-11e7ff228fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd04e2ef-aa2f-4047-9b34-44340b5cb79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-quobyte-cab7e579-0bf8-4ddd-a706-8fcc957e0c7c" released by "_delete_snapshot" :: held 4.934s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-03e9d292-6e6f-424c-a76e-3d7699d8972e" returned: 0 in 0.424s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:34 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1 (d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1): created successfully Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd04e2ef-aa2f-4047-9b34-44340b5cb79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Flow 'volume_create_manager' (3270c8c5-99a9-49c7-84ca-947b60adbc9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-quobyte-d1c70041-6a28-480f-b227-cee447077ea9" released by "delete_snapshot" :: held 5.404s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-03e9d292-6e6f-424c-a76e-3d7699d8972e" released by "delete_volume" :: held 1.944s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:34 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-753976d8-d975-40f8-a7a4-4e3a43c44f80 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created volume successfully. Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Created reservations ['c62e6feb-3ddc-486d-a5d8-d3a0614d4d65', '9f52c187-49fc-4270-b64b-eac6ed3b1696', 'e857836d-c620-4a90-b9f4-3c4e3f907139', '23189384-fa6b-43e9-8bb2-f1216a5b8441'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Created reservations ['3f8d69cc-2fc8-49ca-bfab-f63cdc251887', '1b48fdf9-981b-404a-abbe-26fbce6b8add', '4ac3b222-5b81-4fca-bcb5-a05582f72cde', '4caa5852-2754-4c30-b25f-9270437a9c7e'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:34 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Delete snapshot completed successfully. Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-6cbaeae2-d641-43c6-9b2d-23c01960edfc tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-cab7e579-0bf8-4ddd-a706-8fcc957e0c7c-delete_snapshot" released by "delete_snapshot" :: held 6.149s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.086s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:34 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:34 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Deleted volume successfully. Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c065b36a-36aa-4d33-96a2-5f3cee069a72 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-03e9d292-6e6f-424c-a76e-3d7699d8972e-delete_volume" released by "delete_volume" :: held 4.466s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "cinder-d1c70041-6a28-480f-b227-cee447077ea9-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-d1c70041-6a28-480f-b227-cee447077ea9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:35 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "cinder-quobyte-d1c70041-6a28-480f-b227-cee447077ea9" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-ca95103d-6d73-43ab-93c6-2e66ee31d8bf-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:35 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-quobyte-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-quobyte-d1c70041-6a28-480f-b227-cee447077ea9" acquired by "delete_volume" :: waited 0.035s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1" acquired by "delete_volume" :: waited 0.049s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-ca95103d-6d73-43ab-93c6-2e66ee31d8bf-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4154758-fc0c-4b72-ae8d-7ea709df3061]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[65de3213-ae49-402d-91c2-78f6b5b0056c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:36 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-quobyte-ca95103d-6d73-43ab-93c6-2e66ee31d8bf" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9" returned: 0 in 0.685s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d1c70041-6a28-480f-b227-cee447077ea9" returned: 0 in 0.188s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1" returned: 0 in 0.789s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-ca95103d-6d73-43ab-93c6-2e66ee31d8bf" acquired by "delete_volume" :: waited 0.290s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ccf2e5-0cef-4605-9b20-c17643896067]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-quobyte-d1c70041-6a28-480f-b227-cee447077ea9" released by "delete_volume" :: held 1.251s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1" returned: 0 in 0.452s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1" released by "delete_volume" :: held 1.481s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Created reservations ['78b91a6a-f197-4060-8ef7-0a85718f0e1d', '834dfb32-0bcf-47b2-9372-8f8f345c7809', 'dbe70864-5605-42f2-b2ff-c88062f14432', '9c92cf39-7d9c-47c3-a867-29b1078ecfa5'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created reservations ['170c376b-6c97-42b0-9271-d6d4bb6c13a7', '501b70cc-b5a2-4053-99b2-acaec151b038', '9a170aca-3488-42da-8c5a-d58abcf64645', 'a8b9ed77-cf78-4867-9015-70493c4b4a71'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf" returned: 0 in 0.578s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "cinder-31d9c5e5-0a9c-40df-93cf-1c2b73f56343-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ca95103d-6d73-43ab-93c6-2e66ee31d8bf" returned: 0 in 0.534s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-31d9c5e5-0a9c-40df-93cf-1c2b73f56343-delete_volume" acquired by "delete_volume" :: waited 0.456s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-ca95103d-6d73-43ab-93c6-2e66ee31d8bf" released by "delete_volume" :: held 1.760s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.773s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Deleted volume successfully. Sep 16 02:01:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.541s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:38 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "cinder-quobyte-31d9c5e5-0a9c-40df-93cf-1c2b73f56343" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-92fefc7d-6c43-4682-929b-425b137e5641-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Created reservations ['34dcdff5-c0a9-40c8-b14a-045274ec45ea', '58160a6f-a843-4f8b-9f57-817af6d2f07a', '5272831f-4f37-4376-9abf-7bcabaad267d', '2a6e0eee-1cae-4a49-b631-5079759c6f97'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:39 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Deleted volume successfully. Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-quobyte-31d9c5e5-0a9c-40df-93cf-1c2b73f56343" acquired by "delete_volume" :: waited 0.135s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e47042b7-0d3c-4471-ac4a-2eb6d536cd14 tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-d1c70041-6a28-480f-b227-cee447077ea9-delete_volume" released by "delete_volume" :: held 3.731s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-92fefc7d-6c43-4682-929b-425b137e5641-delete_volume" acquired by "delete_volume" :: waited 0.162s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[108c4527-7f05-4fdd-85b9-6375e324b0f2]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.020s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-263997f7-f92d-44fb-8404-98a2e84d211f tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-d3615c41-b2c7-4b4c-a0bd-2aa92a11a0b1-delete_volume" released by "delete_volume" :: held 4.274s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:40 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-quobyte-92fefc7d-6c43-4682-929b-425b137e5641" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.544s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:40 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Deleted volume successfully. Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343" returned: 0 in 0.927s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-92fefc7d-6c43-4682-929b-425b137e5641" acquired by "delete_volume" :: waited 0.311s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4b516a-3a83-435b-8596-5913e9a3b8b8]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92fefc7d-6c43-4682-929b-425b137e5641 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-13f5b5c9-3853-4810-a2b7-96693655c646 tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-ca95103d-6d73-43ab-93c6-2e66ee31d8bf-delete_volume" released by "delete_volume" :: held 4.985s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-31d9c5e5-0a9c-40df-93cf-1c2b73f56343" returned: 0 in 0.637s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c-delete_volume" acquired by "delete_volume" :: waited 0.327s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-quobyte-31d9c5e5-0a9c-40df-93cf-1c2b73f56343" released by "delete_volume" :: held 1.863s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:41 devstack quobyte-client[83066]: System call of process 98950 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92fefc7d-6c43-4682-929b-425b137e5641" returned: 0 in 0.608s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92fefc7d-6c43-4682-929b-425b137e5641 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:41 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "cinder-quobyte-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-92fefc7d-6c43-4682-929b-425b137e5641" returned: 0 in 0.439s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-92fefc7d-6c43-4682-929b-425b137e5641" released by "delete_volume" :: held 1.246s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Created reservations ['a4ce6e90-a6d2-447a-8b8c-a2f37dc2ed42', '97e94a98-88e2-41f0-b907-e933ab32f441', 'c6ec803c-4b49-41df-8f29-361b4dc87267', 'c5199a9c-8715-4d94-a90a-be685d338d88'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c" acquired by "delete_volume" :: waited 0.145s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c814c31-cbd8-4139-bcb2-0a260e4d52bf]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created reservations ['4965ea66-cc87-4624-b885-690e05987585', '3a2b0b98-5314-4b09-9af4-8c44d41def49', '1464e8e1-36f9-4e6a-b5af-bb2de1025090', '73861b7e-a129-4802-beea-ddc81ae5d6cf'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c" returned: 0 in 0.599s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.033s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c" returned: 0 in 0.533s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.399s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-quobyte-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c" released by "delete_volume" :: held 1.301s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:43 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Deleted volume successfully. Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-3927dce9-1988-4890-93e0-6ba9b2901b80 tempest-CinderUnicodeTest-1980900661 None] Lock "cinder-31d9c5e5-0a9c-40df-93cf-1c2b73f56343-delete_volume" released by "delete_volume" :: held 5.231s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-e6654546-e839-4047-a5f0-6f467c314c03-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.569s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:43 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Deleted volume successfully. Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-e6654546-e839-4047-a5f0-6f467c314c03-delete_volume" acquired by "delete_volume" :: waited 0.163s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Created reservations ['4dc17e6f-7835-4b19-b983-2cc72b2c5113', 'b72fee1c-1133-426c-913b-b4fa30d3b7d1', '190ef58b-59bd-4bd6-9b30-bfe443c26a94', '421e5725-128e-49d9-bc0d-34ede24054b2'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2f0aa7e7-57bd-4626-bc80-f9c48ac8e888 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-92fefc7d-6c43-4682-929b-425b137e5641-delete_volume" released by "delete_volume" :: held 4.784s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-quobyte-e6654546-e839-4047-a5f0-6f467c314c03" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-e6654546-e839-4047-a5f0-6f467c314c03" acquired by "delete_volume" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f869b3-1722-4489-af8b-f1ba9e7b9a37]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6654546-e839-4047-a5f0-6f467c314c03 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.252s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Deleted volume successfully. Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-5e217441-5214-49b0-8087-3ee7411b3fef tempest-CreateVolumesFromImageTest-1170534153 None] Lock "cinder-188f3524-a8d5-41ea-a75e-df2c5ecd0d1c-delete_volume" released by "delete_volume" :: held 4.072s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6654546-e839-4047-a5f0-6f467c314c03" returned: 0 in 0.687s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6654546-e839-4047-a5f0-6f467c314c03 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e6654546-e839-4047-a5f0-6f467c314c03" returned: 0 in 0.197s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-e6654546-e839-4047-a5f0-6f467c314c03" released by "delete_volume" :: held 1.230s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created reservations ['02b79f3e-3b42-492f-b3ec-f5bb525591ff', 'ec56cda5-ace5-43a6-bb61-4d1462a06bf7', '8ba4b1e2-4741-4191-b055-e85a1b78c3fe', '17f44703-a56e-4789-9174-ae69d3ca8257'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:46 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-02240e58-d0db-4918-86f3-bcda5fbe89a3-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.687s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:46 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-02240e58-d0db-4918-86f3-bcda5fbe89a3-delete_volume" acquired by "delete_volume" :: waited 0.315s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:46 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Deleted volume successfully. Sep 16 02:01:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-de8c1530-947b-441f-b064-864fac839c6c tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-e6654546-e839-4047-a5f0-6f467c314c03-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:47 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-quobyte-02240e58-d0db-4918-86f3-bcda5fbe89a3" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:47 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-02240e58-d0db-4918-86f3-bcda5fbe89a3" acquired by "delete_volume" :: waited 0.025s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:47 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3aa4a84-81d8-4e5a-a60b-393ad9f21494]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02240e58-d0db-4918-86f3-bcda5fbe89a3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02240e58-d0db-4918-86f3-bcda5fbe89a3" returned: 0 in 0.582s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:47 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02240e58-d0db-4918-86f3-bcda5fbe89a3 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:48 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-02240e58-d0db-4918-86f3-bcda5fbe89a3" returned: 0 in 0.232s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:48 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-02240e58-d0db-4918-86f3-bcda5fbe89a3" released by "delete_volume" :: held 1.507s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created reservations ['3b45523a-84ca-49ed-b9aa-3a2783794ef2', '23c961e0-b9a8-4af3-a1af-f3481efee704', 'b45c1522-b3cd-4575-bab0-c860dd1e968a', '1a59ba54-88ae-4cea-b02c-5a39164975ac'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.141s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:49 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:50 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Deleted volume successfully. Sep 16 02:01:50 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-f59e0f02-64f0-449e-a2df-409ee1f62764 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-02240e58-d0db-4918-86f3-bcda5fbe89a3-delete_volume" released by "delete_volume" :: held 3.666s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:50 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-1ff463e8-b45c-4db3-a64e-f0315febc344-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:50 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-1ff463e8-b45c-4db3-a64e-f0315febc344-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:51 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-quobyte-1ff463e8-b45c-4db3-a64e-f0315febc344" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:51 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-1ff463e8-b45c-4db3-a64e-f0315febc344" acquired by "delete_volume" :: waited 0.015s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:51 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[1027d866-8f8e-466a-8129-db5969f9f324]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1ff463e8-b45c-4db3-a64e-f0315febc344 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1ff463e8-b45c-4db3-a64e-f0315febc344" returned: 0 in 0.547s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1ff463e8-b45c-4db3-a64e-f0315febc344 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:51 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-1ff463e8-b45c-4db3-a64e-f0315febc344" returned: 0 in 0.117s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-1ff463e8-b45c-4db3-a64e-f0315febc344" released by "delete_volume" :: held 0.958s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created reservations ['3693342d-d1e3-4c6f-a4ad-13606d8d8de3', '884b98be-12e1-41eb-9b4d-b75e03df917f', 'e9d56852-89e9-416a-9c9e-db33dc3cd619', 'db1cbcc8-852d-46e9-b646-1ae6ea0329da'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.133s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:52 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:01:52 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Deleted volume successfully. Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-f6ccf35d-ff0a-430e-a825-4d2f3d7b393b-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-1a09d74f-9f51-420e-9576-70bca42fded1 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-1ff463e8-b45c-4db3-a64e-f0315febc344-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-f6ccf35d-ff0a-430e-a825-4d2f3d7b393b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:53 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-quobyte-964a7333-c8ef-47db-98f5-5e770219caa9" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:53 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Flow 'volume_create_manager' (77b4c5cb-4bcd-4741-aa42-453500d65d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dc994e-afa1-40d8-9de0-6138d8237d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dc994e-afa1-40d8-9de0-6138d8237d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e354bae2-214d-4734-9b0e-5868d389d6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534bb4274f16420aa49ff6b90355af4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:53Z,use_quota=True,user_id='b6484742c8dc4f36907686fce9ae4bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f99f479-2212-4610-8ed5-45e9d3688ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f99f479-2212-4610-8ed5-45e9d3688ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b25190-2c9a-48b3-9445-d5b2de871162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.image.glance [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Creating Keystone auth plugin from conf {{(pid=83041) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-964a7333-c8ef-47db-98f5-5e770219caa9" acquired by "delete_snapshot" :: waited 0.220s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-quobyte-f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Deleting offline snapshot f6ccf35d-ff0a-430e-a825-4d2f3d7b393b of volume 964a7333-c8ef-47db-98f5-5e770219caa9 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] snapshot_file for this snap is: volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cb2698-8e58-49d4-b709-a1597a0d0ecd]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:53 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:54 devstack quobyte-client[83066]: System call of process 99013 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70b25190-2c9a-48b3-9445-d5b2de871162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e354bae2-214d-4734-9b0e-5868d389d6d6', 'volume_name': 'volume-e354bae2-214d-4734-9b0e-5868d389d6d6', 'volume_size': 1, 'image_id': 'dddcf630-5e19-4090-bec3-5e5d350cdf26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dddcf630-5e19-4090-bec3-5e5d350cdf26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '635bf9524146b379b58178e79379607a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '534bb4274f16420aa49ff6b90355af4e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd63bcce4e82b6ba38ef3615de144a90e6d0c6778cf12e6ee41c8e2976c37a6a5d826af6147536a7f306d1e2b11e32d60b296ec6d15379200d0d0789b74228ed4', 'id': 'dddcf630-5e19-4090-bec3-5e5d350cdf26', 'created_at': datetime.datetime(2025, 9, 16, 0, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 0, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dddcf630-5e19-4090-bec3-5e5d350cdf26/file', 'properties': {}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a3170a-0897-4b28-9ee9-0790fc3b5624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54a3170a-0897-4b28-9ee9-0790fc3b5624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5bdb18-b205-4869-89f9-6bbb59297a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:01:54 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Volume e354bae2-214d-4734-9b0e-5868d389d6d6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e354bae2-214d-4734-9b0e-5868d389d6d6', 'volume_size': 1, 'image_id': 'dddcf630-5e19-4090-bec3-5e5d350cdf26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dddcf630-5e19-4090-bec3-5e5d350cdf26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '635bf9524146b379b58178e79379607a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '534bb4274f16420aa49ff6b90355af4e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd63bcce4e82b6ba38ef3615de144a90e6d0c6778cf12e6ee41c8e2976c37a6a5d826af6147536a7f306d1e2b11e32d60b296ec6d15379200d0d0789b74228ed4', 'id': 'dddcf630-5e19-4090-bec3-5e5d350cdf26', 'created_at': datetime.datetime(2025, 9, 16, 0, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 0, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dddcf630-5e19-4090-bec3-5e5d350cdf26/file', 'properties': {}}, 'image_service': } Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Cloning e354bae2-214d-4734-9b0e-5868d389d6d6 from image dddcf630-5e19-4090-bec3-5e5d350cdf26 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dddcf630-5e19-4090-bec3-5e5d350cdf26', 'metadata': {}}]). {{(pid=83041) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" returned: 0 in 0.682s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-964a7333-c8ef-47db-98f5-5e770219caa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[40185379-cee5-449a-85c4-9b94eb061c11]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}} Sep 16 02:01:54 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Image download 0.00 MB at 0.00 MB/s Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2a0414-6439-434b-a9fc-44b6ad0c1032]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:54 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9" returned: 0 in 0.804s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:55 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD Sep 16 02:01:55 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 02:01:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" returned: 0 in 0.367s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:55 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:56 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9.f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" returned: 0 in 0.278s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-f6ccf35d-ff0a-430e-a825-4d2f3d7b393b" released by "_delete_snapshot" :: held 2.831s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:56 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-964a7333-c8ef-47db-98f5-5e770219caa9" released by "delete_snapshot" :: held 2.867s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:56 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created reservations ['ac9919ba-2780-4e44-a137-e1c154d9b75e', '6febbbaa-cc5f-4148-960e-9793d941b75c', '3f555991-d90c-4d05-83fc-bfaa2f97b0ea', 'd55d4484-e40c-4a6f-b0f0-474c38658e56'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:01:57 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Delete snapshot completed successfully. Sep 16 02:01:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-210245ba-114f-4c39-a073-1010424f7caa tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-f6ccf35d-ff0a-430e-a825-4d2f3d7b393b-delete_snapshot" released by "delete_snapshot" :: held 3.915s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-964a7333-c8ef-47db-98f5-5e770219caa9-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:57 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-964a7333-c8ef-47db-98f5-5e770219caa9-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:58 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:01:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "cinder-quobyte-964a7333-c8ef-47db-98f5-5e770219caa9" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:01:58 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-964a7333-c8ef-47db-98f5-5e770219caa9" acquired by "delete_volume" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:01:58 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6117969c-c22b-4aff-8266-6c266327397f]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:01:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:58 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Sep 16 02:01:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD" returned: 0 in 3.705s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:58 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9" returned: 0 in 0.860s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:01:59 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD Sep 16 02:01:59 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 02:01:59 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-964a7333-c8ef-47db-98f5-5e770219caa9" returned: 0 in 0.188s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:01:59 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-quobyte-964a7333-c8ef-47db-98f5-5e770219caa9" released by "delete_volume" :: held 1.414s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:01:59 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Created reservations ['e4c01442-0a93-4f66-936c-86f613e4c259', 'b346a975-0272-44bc-8ffe-5c0714eff479', '293847ae-08c5-46d5-863e-4f6b52c1cf73', '5a215a6d-f3ed-46f5-9dab-6a20c635059d'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:00 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:00 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.205s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:00 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:00 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Deleted volume successfully. Sep 16 02:02:01 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-e33a6a73-ae99-4258-88f5-f2bf8f567366 tempest-CreateVolumesFromSnapshotTest-1162667257 None] Lock "cinder-964a7333-c8ef-47db-98f5-5e770219caa9-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:02 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Sep 16 02:02:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD" returned: 1 in 3.727s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 02:02:02 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Temporary image dddcf630-5e19-4090-bec3-5e5d350cdf26 is fetched for user b6484742c8dc4f36907686fce9ae4bf2. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}} Sep 16 02:02:02 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=103,cinder:UPDATE=141,cinder:DELETE=11,cinder:INSERT=31 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 02:02:02 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=81,cinder:UPDATE=146,cinder:DELETE=17,cinder:INSERT=29 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 02:02:02 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06d92d8-3d7b-417c-8ff0-41a6101bfa9f]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:02 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:03 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD Sep 16 02:02:03 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:05 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD" returned: 0 in 3.153s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.564s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:06 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (322f8b47-3c59-402e-bf74-71e19e6895de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93bf23b-7ac7-4006-bce5-04339e05fe34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a93bf23b-7ac7-4006-bce5-04339e05fe34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-902996777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d283c168-13b0-40ce-966d-0a4ea8287b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:05Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b830dee-14c5-4e42-9dab-b692389a3826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b830dee-14c5-4e42-9dab-b692389a3826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4740ba2e-4fe3-414e-808c-c3a075066baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4740ba2e-4fe3-414e-808c-c3a075066baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd283c168-13b0-40ce-966d-0a4ea8287b4c', 'volume_name': 'volume-d283c168-13b0-40ce-966d-0a4ea8287b4c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:06 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD Sep 16 02:02:06 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6e754e-bfdb-488f-a3ca-954717f4eacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6e754e-bfdb-488f-a3ca-954717f4eacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a56971-8026-42e9-bb5b-a8662b5a9c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:06 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume d283c168-13b0-40ce-966d-0a4ea8287b4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d283c168-13b0-40ce-966d-0a4ea8287b4c', 'volume_size': 1} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-902996777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d283c168-13b0-40ce-966d-0a4ea8287b4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:05Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Creating volume d283c168-13b0-40ce-966d-0a4ea8287b4c {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:06 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d283c168-13b0-40ce-966d-0a4ea8287b4c 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:06 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=163, name=volume-d283c168-13b0-40ce-966d-0a4ea8287b4c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d283c168-13b0-40ce-966d-0a4ea8287b4c 1073741824" returned: 0 in 0.476s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:06 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d283c168-13b0-40ce-966d-0a4ea8287b4c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d283c168-13b0-40ce-966d-0a4ea8287b4c" returned: 0 in 0.150s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:07 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] <== create_volume: return (729ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:02:07 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4a56971-8026-42e9-bb5b-a8662b5a9c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d283c168-13b0-40ce-966d-0a4ea8287b4c', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc40b32-2d67-4694-85ae-14beeff189a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:07 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume volume-d283c168-13b0-40ce-966d-0a4ea8287b4c (d283c168-13b0-40ce-966d-0a4ea8287b4c): created successfully Sep 16 02:02:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dc40b32-2d67-4694-85ae-14beeff189a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:07 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (322f8b47-3c59-402e-bf74-71e19e6895de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:07 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-f8943ea7-3a3e-4111-bbd3-a42c6edb0078 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created volume successfully. Sep 16 02:02:08 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD" returned: 1 in 2.860s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e354bae2-214d-4734-9b0e-5868d389d6d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='534bb4274f16420aa49ff6b90355af4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:01:53Z,use_quota=True,user_id='b6484742c8dc4f36907686fce9ae4bf2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Creating volume e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:08 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:02:08 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:08 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=164, name=volume-e354bae2-214d-4734-9b0e-5868d389d6d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 1073741824" returned: 0 in 0.926s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:09 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:09 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (1f241626-f7d9-44d1-909a-cc874c33515b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e235e537-67d7-4839-9d41-e80b8a6a4c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e235e537-67d7-4839-9d41-e80b8a6a4c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561843833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee749809-e319-456b-bbd5-912320597cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:09Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94671c98-76f1-4be2-94cb-7ab80cb7a14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94671c98-76f1-4be2-94cb-7ab80cb7a14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578d638b-ed50-4714-b929-87d52a829df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578d638b-ed50-4714-b929-87d52a829df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee749809-e319-456b-bbd5-912320597cbc', 'volume_name': 'volume-ee749809-e319-456b-bbd5-912320597cbc', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6a6a6-ddf2-48f6-a8ed-14713484181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87a6a6a6-ddf2-48f6-a8ed-14713484181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1379b52-e9d0-4a84-97a3-7f2ee9ea0f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:10 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume ee749809-e319-456b-bbd5-912320597cbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee749809-e319-456b-bbd5-912320597cbc', 'volume_size': 1} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6" returned: 0 in 0.924s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] <== create_volume: return (1888ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561843833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee749809-e319-456b-bbd5-912320597cbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:09Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Creating volume ee749809-e319-456b-bbd5-912320597cbc {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:10 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:02:10 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ee749809-e319-456b-bbd5-912320597cbc 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:10 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=165, name=volume-ee749809-e319-456b-bbd5-912320597cbc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (385fdc85-57e5-488b-aff3-f84a35753560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b517d86c-0592-49bf-beb9-8f1baddc454a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (5cb95f51-a268-405e-823d-2d55800b5f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52c6fc6-0022-4066-a460-e41a4ed27e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52c6fc6-0022-4066-a460-e41a4ed27e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1536643603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2b855e-310d-413a-b061-e80cdba6f03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:10Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e10930e-4c22-4016-86aa-20e27f146c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e10930e-4c22-4016-86aa-20e27f146c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0662f809-c039-4a1e-84e7-f5370d384ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0662f809-c039-4a1e-84e7-f5370d384ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a2b855e-310d-413a-b061-e80cdba6f03b', 'volume_name': 'volume-9a2b855e-310d-413a-b061-e80cdba6f03b', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57db3db6-35dd-458e-8f68-8b5eb4dce0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57db3db6-35dd-458e-8f68-8b5eb4dce0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46272aca-6566-4cf3-8be8-57690827e777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume 9a2b855e-310d-413a-b061-e80cdba6f03b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a2b855e-310d-413a-b061-e80cdba6f03b', 'volume_size': 1} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ee749809-e319-456b-bbd5-912320597cbc 1073741824" returned: 0 in 0.859s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:11 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (9958f3c8-e342-4df3-9994-1fcc8ea57d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb000c6a-0b7b-4bf5-a404-3235c52b7bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b517d86c-0592-49bf-beb9-8f1baddc454a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726665411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c19588b-8ae0-4806-8019-1623b6c1b1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:09Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1047be-de45-4a90-8579-ec04b7cf3ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d1047be-de45-4a90-8579-ec04b7cf3ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d7a1d7-7218-4bdf-ad74-40b43eeed375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d7a1d7-7218-4bdf-ad74-40b43eeed375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c19588b-8ae0-4806-8019-1623b6c1b1d8', 'volume_name': 'volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80edc1c-1d71-4281-b2a4-033b931dbe18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80edc1c-1d71-4281-b2a4-033b931dbe18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6768ca87-5280-4fe3-9d85-5d308e91b7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:11 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume 9c19588b-8ae0-4806-8019-1623b6c1b1d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8', 'volume_size': 1} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Attempting download of dddcf630-5e19-4090-bec3-5e5d350cdf26 ((None, [{'url': 'file:///opt/stack/data/glance/images/dddcf630-5e19-4090-bec3-5e5d350cdf26', 'metadata': {}}])) to volume e354bae2-214d-4734-9b0e-5868d389d6d6. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Sep 16 02:02:11 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ee749809-e319-456b-bbd5-912320597cbc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb000c6a-0b7b-4bf5-a404-3235c52b7bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1227903295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24b92aa-0dcc-45dd-8922-25ff6926b494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:10Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f9b2a4-a852-4a5e-9a02-1415f8da9f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92f9b2a4-a852-4a5e-9a02-1415f8da9f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1948ba2f-e27e-4a89-87d8-c00b02b22584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1948ba2f-e27e-4a89-87d8-c00b02b22584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd24b92aa-0dcc-45dd-8922-25ff6926b494', 'volume_name': 'volume-d24b92aa-0dcc-45dd-8922-25ff6926b494', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1a3a96-fa32-4706-afbf-ef1eff0fd40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd1a3a96-fa32-4706-afbf-ef1eff0fd40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0b9f8-fbf2-4fb7-b19f-c3e4a18796b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume d24b92aa-0dcc-45dd-8922-25ff6926b494: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d24b92aa-0dcc-45dd-8922-25ff6926b494', 'volume_size': 1} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:12 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (bb1cc719-f919-4b4b-8514-fb5ffd2c03d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ff3576-d139-43ed-8817-1916a2b464f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ee749809-e319-456b-bbd5-912320597cbc" returned: 0 in 0.687s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ff3576-d139-43ed-8817-1916a2b464f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1757282672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45407560-b371-4b90-8678-0bcc8b3810be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:11Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d321acf5-9f6c-4fcd-a790-992a1adc4dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d321acf5-9f6c-4fcd-a790-992a1adc4dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c18ecf-c3d1-4476-98d7-21eb6e3c57b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7c18ecf-c3d1-4476-98d7-21eb6e3c57b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45407560-b371-4b90-8678-0bcc8b3810be', 'volume_name': 'volume-45407560-b371-4b90-8678-0bcc8b3810be', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd18ab4-e069-440e-9e8d-816daf85f906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccd18ab4-e069-440e-9e8d-816daf85f906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d15be04-c0f8-43da-925e-b1ad9a591df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:12 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume 45407560-b371-4b90-8678-0bcc8b3810be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45407560-b371-4b90-8678-0bcc8b3810be', 'volume_size': 1} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] <== create_volume: return (1752ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c6e174-0baf-45bf-aec5-99211cc26dc5]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.903s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1536643603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a2b855e-310d-413a-b061-e80cdba6f03b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:10Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Creating volume 9a2b855e-310d-413a-b061-e80cdba6f03b {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:12 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9a2b855e-310d-413a-b061-e80cdba6f03b 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dddcf630-5e19-4090-bec3-5e5d350cdf26_z9soj8pa {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:12 devstack quobyte-client[83066]: System call of process 99061 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:12 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=166, name=volume-9a2b855e-310d-413a-b061-e80cdba6f03b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1379b52-e9d0-4a84-97a3-7f2ee9ea0f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee749809-e319-456b-bbd5-912320597cbc', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:12 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f180658-53f9-4cda-8fb8-87b9acc6b0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9a2b855e-310d-413a-b061-e80cdba6f03b 1073741824" returned: 0 in 0.695s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9a2b855e-310d-413a-b061-e80cdba6f03b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:13 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume volume-ee749809-e319-456b-bbd5-912320597cbc (ee749809-e319-456b-bbd5-912320597cbc): created successfully Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f180658-53f9-4cda-8fb8-87b9acc6b0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (1f241626-f7d9-44d1-909a-cc874c33515b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:13 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-02a192eb-8e61-4961-ae8a-bcfd4d2f6082 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created volume successfully. Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dddcf630-5e19-4090-bec3-5e5d350cdf26_z9soj8pa" returned: 0 in 1.255s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9a2b855e-310d-413a-b061-e80cdba6f03b" returned: 0 in 0.614s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dddcf630-5e19-4090-bec3-5e5d350cdf26_z9soj8pa {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] <== create_volume: return (1410ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:02:13 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.522s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-726665411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c19588b-8ae0-4806-8019-1623b6c1b1d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:09Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Creating volume 9c19588b-8ae0-4806-8019-1623b6c1b1d8 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:14 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:14 devstack quobyte-client[83066]: System call of process 99068 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:14 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=167, name=volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46272aca-6566-4cf3-8be8-57690827e777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a2b855e-310d-413a-b061-e80cdba6f03b', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4155d91-2ab1-4011-b15c-0673a220e8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dddcf630-5e19-4090-bec3-5e5d350cdf26_z9soj8pa" returned: 1 in 1.156s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dddcf630-5e19-4090-bec3-5e5d350cdf26_z9soj8pa' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8 1073741824" returned: 0 in 0.728s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[c973ab78-1ea2-4bbc-9d4d-9f2443dc5e17]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:14 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:15 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume volume-9a2b855e-310d-413a-b061-e80cdba6f03b (9a2b855e-310d-413a-b061-e80cdba6f03b): created successfully Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4155d91-2ab1-4011-b15c-0673a220e8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (5cb95f51-a268-405e-823d-2d55800b5f40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:15 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2dec2071-323f-4318-804c-9b04ff699084 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created volume successfully. Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8" returned: 0 in 0.983s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] <== create_volume: return (1786ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.765s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1227903295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d24b92aa-0dcc-45dd-8922-25ff6926b494,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:10Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Creating volume d24b92aa-0dcc-45dd-8922-25ff6926b494 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:15 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:02:15 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d24b92aa-0dcc-45dd-8922-25ff6926b494 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD" returned: 0 in 1.079s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:16 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=168, name=volume-d24b92aa-0dcc-45dd-8922-25ff6926b494, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:16 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6768ca87-5280-4fe3-9d85-5d308e91b7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:16 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e91c6c5-e17f-412d-bb49-f79393a12565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d24b92aa-0dcc-45dd-8922-25ff6926b494 1073741824" returned: 0 in 1.163s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d24b92aa-0dcc-45dd-8922-25ff6926b494 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD" returned: 1 in 0.765s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] dddcf630-5e19-4090-bec3-5e5d350cdf26 was raw, converting to raw {{(pid=83041) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:17 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=164, name=volume-e354bae2-214d-4734-9b0e-5868d389d6d6, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:17 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8 (9c19588b-8ae0-4806-8019-1623b6c1b1d8): created successfully Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e91c6c5-e17f-412d-bb49-f79393a12565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (385fdc85-57e5-488b-aff3-f84a35753560) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6" returned: 0 in 0.432s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d24b92aa-0dcc-45dd-8922-25ff6926b494" returned: 0 in 0.618s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dddcf630-5e19-4090-bec3-5e5d350cdf26_d6aatfwadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 02:02:17 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Converted 0.00 MB image at 0.00 MB/s Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] <== create_volume: return (1906ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:02:17 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:17 devstack quobyte-client[83066]: System call of process 99086 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.867s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1757282672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45407560-b371-4b90-8678-0bcc8b3810be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='668d0044b9464ddf8700df78bf645829',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:11Z,use_quota=True,user_id='6b1f2829947d4d7789e2107095586628',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Creating volume 45407560-b371-4b90-8678-0bcc8b3810be {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:18 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45407560-b371-4b90-8678-0bcc8b3810be 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:18 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-d1071a21-01e7-488e-b57d-f8b038c56047 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created volume successfully. Sep 16 02:02:18 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=169, name=volume-45407560-b371-4b90-8678-0bcc8b3810be, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23d0b9f8-fbf2-4fb7-b19f-c3e4a18796b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d24b92aa-0dcc-45dd-8922-25ff6926b494', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef0f146-b568-4e2d-bf5d-8467a7ec59a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 1G" returned: 0 in 1.057s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45407560-b371-4b90-8678-0bcc8b3810be 1073741824" returned: 0 in 0.526s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45407560-b371-4b90-8678-0bcc8b3810be {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:18 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume volume-d24b92aa-0dcc-45dd-8922-25ff6926b494 (d24b92aa-0dcc-45dd-8922-25ff6926b494): created successfully Sep 16 02:02:18 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ef0f146-b568-4e2d-bf5d-8467a7ec59a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (9958f3c8-e342-4df3-9994-1fcc8ea57d48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd3cad-fabd-40d9-8b2d-9352b8e624fb]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45407560-b371-4b90-8678-0bcc8b3810be" returned: 0 in 0.595s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] <== create_volume: return (1188ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:19 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-ce7bb903-4fde-4117-834e-1083e92fc265 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created volume successfully. Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d15be04-c0f8-43da-925e-b1ad9a591df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45407560-b371-4b90-8678-0bcc8b3810be', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bfdcf4-c5a0-46f6-aaea-0f785c7c9680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:19 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume volume-45407560-b371-4b90-8678-0bcc8b3810be (45407560-b371-4b90-8678-0bcc8b3810be): created successfully Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03bfdcf4-c5a0-46f6-aaea-0f785c7c9680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Flow 'volume_create_manager' (bb1cc719-f919-4b4b-8514-fb5ffd2c03d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:19 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-caec4e76-6c2e-43d4-8901-5666701a9eb3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created volume successfully. Sep 16 02:02:19 devstack quobyte-client[83066]: System call of process 99093 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6" returned: 0 in 0.594s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:19 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:20 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:02:20 devstack quobyte-client[83066]: System call of process 99095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Flow 'volume_create_manager' (378327e7-86fd-4b36-9033-02fa404b5c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2670e5-4092-4764-a1a2-256c8e559c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2670e5-4092-4764-a1a2-256c8e559c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1754232595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa90ca818a954bf49ccd8c5e34090c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:20Z,use_quota=True,user_id='49505cc3fc164c809ebc9125f92a76f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375879a3-b0aa-46a0-8b82-f6c4c32e71fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375879a3-b0aa-46a0-8b82-f6c4c32e71fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c95b189-a6a1-4f86-9cef-915426ac72e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c95b189-a6a1-4f86-9cef-915426ac72e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96', 'volume_name': 'volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3a4901-9307-4b2e-81e8-05387a9723ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3a4901-9307-4b2e-81e8-05387a9723ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dea50d1-e8c7-4662-a91a-09306774ec31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:20 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Volume c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96', 'volume_size': 1} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1754232595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa90ca818a954bf49ccd8c5e34090c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:20Z,use_quota=True,user_id='49505cc3fc164c809ebc9125f92a76f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)}" {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Creating volume c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:20 devstack cinder-volume[83041]: INFO cinder.volume.drivers.remotefs [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] casted to 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 1073741824 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-45407560-b371-4b90-8678-0bcc8b3810be-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:20 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=170, name=volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6" returned: 1 in 1.032s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Downloaded image dddcf630-5e19-4090-bec3-5e5d350cdf26 ((None, [{'url': 'file:///opt/stack/data/glance/images/dddcf630-5e19-4090-bec3-5e5d350cdf26', 'metadata': {}}])) to volume e354bae2-214d-4734-9b0e-5868d389d6d6 successfully. {{(pid=83041) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Temporary image dddcf630-5e19-4090-bec3-5e5d350cdf26 for user b6484742c8dc4f36907686fce9ae4bf2 is deleted. {{(pid=83041) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG cinder.volume.volume_utils [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Marking volume e354bae2-214d-4734-9b0e-5868d389d6d6 as bootable. {{(pid=83041) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 1073741824" returned: 0 in 0.452s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:20 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-45407560-b371-4b90-8678-0bcc8b3810be-delete_volume" acquired by "delete_volume" :: waited 0.463s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Copying metadata from image dddcf630-5e19-4090-bec3-5e5d350cdf26 to e354bae2-214d-4734-9b0e-5868d389d6d6. {{(pid=83041) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Creating volume glance metadata for volume e354bae2-214d-4734-9b0e-5868d389d6d6 backed by image dddcf630-5e19-4090-bec3-5e5d350cdf26 with: {'image_id': 'dddcf630-5e19-4090-bec3-5e5d350cdf26', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '635bf9524146b379b58178e79379607a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=83041) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" returned: 0 in 0.403s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] <== create_volume: return (882ms) {'provider_location': '10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'} {{(pid=83041) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:21 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-quobyte-45407560-b371-4b90-8678-0bcc8b3810be" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dea50d1-e8c7-4662-a91a-09306774ec31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96', 'volume_size': 1}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea30839d-b053-4101-9574-e47fbcd5fe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-45407560-b371-4b90-8678-0bcc8b3810be" acquired by "delete_volume" :: waited 0.091s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:21 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Volume volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 (c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96): created successfully Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea30839d-b053-4101-9574-e47fbcd5fe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Flow 'volume_create_manager' (378327e7-86fd-4b36-9033-02fa404b5c86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7810df3d-07e8-4c5b-8d8c-6ab002843e92]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45407560-b371-4b90-8678-0bcc8b3810be {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c5bdb18-b205-4869-89f9-6bbb59297a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e354bae2-214d-4734-9b0e-5868d389d6d6', 'volume_size': 1, 'image_id': 'dddcf630-5e19-4090-bec3-5e5d350cdf26', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dddcf630-5e19-4090-bec3-5e5d350cdf26', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '635bf9524146b379b58178e79379607a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '534bb4274f16420aa49ff6b90355af4e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd63bcce4e82b6ba38ef3615de144a90e6d0c6778cf12e6ee41c8e2976c37a6a5d826af6147536a7f306d1e2b11e32d60b296ec6d15379200d0d0789b74228ed4', 'id': 'dddcf630-5e19-4090-bec3-5e5d350cdf26', 'created_at': datetime.datetime(2025, 9, 16, 0, 1, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 16, 0, 1, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dddcf630-5e19-4090-bec3-5e5d350cdf26/file', 'properties': {}}, 'image_service': }' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:21 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b2216e-a21a-421c-bb87-2d7c9ca62767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:21 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-12372148-1d33-4c73-9f88-74984672a176 tempest-SnapshotDependencyTests-1853226544 None] Created volume successfully. Sep 16 02:02:22 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Volume volume-e354bae2-214d-4734-9b0e-5868d389d6d6 (e354bae2-214d-4734-9b0e-5868d389d6d6): created successfully Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78b2216e-a21a-421c-bb87-2d7c9ca62767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Flow 'volume_create_manager' (77b4c5cb-4bcd-4741-aa42-453500d65d09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:22 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-1b34afb9-bb89-4a25-a440-ae8b4082fb72 tempest-VolumeImageDependencyTests-1962391430 None] Created volume successfully. Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45407560-b371-4b90-8678-0bcc8b3810be" returned: 0 in 0.590s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45407560-b371-4b90-8678-0bcc8b3810be {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-45407560-b371-4b90-8678-0bcc8b3810be" returned: 0 in 0.118s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Acquiring lock "cinder-e354bae2-214d-4734-9b0e-5868d389d6d6-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-45407560-b371-4b90-8678-0bcc8b3810be" released by "delete_volume" :: held 1.202s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Lock "cinder-e354bae2-214d-4734-9b0e-5868d389d6d6-delete_volume" acquired by "delete_volume" :: waited 0.123s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:22 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Creating offline snapshot cc414fd8-9da4-409f-9d3a-3616d5898a91 of volume c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc256dc-1278-4baa-aab7-6b01d5584d28]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:22 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:23 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Acquiring lock "cinder-quobyte-e354bae2-214d-4734-9b0e-5868d389d6d6" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:23 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created reservations ['15654e43-895d-4568-bb53-2f65611a939f', '865e6ccf-9642-49fb-bdde-6195db8e8b71', '0519aeee-b59d-4fe4-84a5-1756f978cfa1', '8cad63ea-2562-43e2-be63-24b730fab596'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:23 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Lock "cinder-quobyte-e354bae2-214d-4734-9b0e-5868d389d6d6" acquired by "delete_volume" :: waited 0.224s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:23 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f819039-702a-4ecb-8d00-a15ed63617ed]: (4, 'raw') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" returned: 0 in 0.952s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:23 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 1G {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:24 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=171, name=volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 1G" returned: 0 in 0.384s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:24 devstack quobyte-client[83066]: System call of process 99114 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6" returned: 0 in 1.039s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] CMD "qemu-img rebase -u -b volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 -F qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91" returned: 0 in 0.434s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:24 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:02:24 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91" returned: 0 in 0.242s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Setting permissions: /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 -> 1000:1000 {{(pid=83041) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-9a2b855e-310d-413a-b061-e80cdba6f03b-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91" returned: 0 in 0.547s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6" returned: 1 in 1.171s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6' failed. Not Retrying. {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-9a2b855e-310d-413a-b061-e80cdba6f03b-delete_volume" acquired by "delete_volume" :: waited 0.541s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:25 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.799s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:26 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.info" returned: 0 in 0.962s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:26 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.info is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:02:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.info {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:26 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Deleted volume successfully. Sep 16 02:02:26 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-e354bae2-214d-4734-9b0e-5868d389d6d6" returned: 0 in 0.892s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.info" returned: 0 in 0.394s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Lock "cinder-quobyte-e354bae2-214d-4734-9b0e-5868d389d6d6" released by "delete_volume" :: held 3.645s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.211s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-69c0a73d-0790-4673-8981-5e337dc847d7 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-45407560-b371-4b90-8678-0bcc8b3810be-delete_volume" released by "delete_volume" :: held 6.042s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:27 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-quobyte-9a2b855e-310d-413a-b061-e80cdba6f03b" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-9a2b855e-310d-413a-b061-e80cdba6f03b" acquired by "delete_volume" :: waited 0.033s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:27 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-630e0bfc-e3c3-4139-8780-1a0aa2538c9f tempest-SnapshotDependencyTests-1853226544 None] Create snapshot completed successfully Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3e9e2e-86de-46ce-ac63-d2f247f14862]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9a2b855e-310d-413a-b061-e80cdba6f03b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Created reservations ['75623516-b553-4c03-bddc-20a8726216b1', '1ea8e444-4b08-4f98-b331-17832071a41f', '8a0e3f1f-be81-4abf-a4e3-18b843f56b74', '7bcbf590-32fd-45f3-9a08-5bcb0e427588'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9a2b855e-310d-413a-b061-e80cdba6f03b" returned: 0 in 0.680s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:27 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9a2b855e-310d-413a-b061-e80cdba6f03b {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.209s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:28 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Deleted volume successfully. Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9a2b855e-310d-413a-b061-e80cdba6f03b" returned: 0 in 0.327s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-9a2b855e-310d-413a-b061-e80cdba6f03b" released by "delete_volume" :: held 1.180s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4bdc51f2-3d26-4fff-94a9-f480dde4506c tempest-VolumeImageDependencyTests-1962391430 None] Lock "cinder-e354bae2-214d-4734-9b0e-5868d389d6d6-delete_volume" released by "delete_volume" :: held 5.615s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:28 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.flows.manager.create_volume [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=83041) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Flow 'volume_create_manager' (acee8f83-2044-4a68-bcf1-031b3af999c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c0d5fc-cd9a-43b1-8a26-cf50b81ea218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c0d5fc-cd9a-43b1-8a26-cf50b81ea218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2025-09-16T00:02:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d014a9-2885-4a42-84af-0ce2ccbff9c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa90ca818a954bf49ccd8c5e34090c8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-16T00:02:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cc414fd8-9da4-409f-9d3a-3616d5898a91,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-16T00:02:29Z,use_quota=True,user_id='49505cc3fc164c809ebc9125f92a76f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(60bec9ce-a001-42b6-8852-430dd8704324),volume_type_id=60bec9ce-a001-42b6-8852-430dd8704324)' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d1bcaf-d8f6-4126-b848-cf0137e61e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d1bcaf-d8f6-4126-b848-cf0137e61e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780e9707-1206-4c80-bdf2-4f3912f76321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (780e9707-1206-4c80-bdf2-4f3912f76321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55d014a9-2885-4a42-84af-0ce2ccbff9c9', 'volume_name': 'volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9', 'volume_size': 1, 'snapshot_id': 'cc414fd8-9da4-409f-9d3a-3616d5898a91'}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532ddd55-f1ae-4b3d-b2e6-c8da36b97dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532ddd55-f1ae-4b3d-b2e6-c8da36b97dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664d9ce4-a187-4d60-8c91-4db2dcde153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:28 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Volume 55d014a9-2885-4a42-84af-0ce2ccbff9c9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9', 'volume_size': 1, 'snapshot_id': 'cc414fd8-9da4-409f-9d3a-3616d5898a91'} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-quobyte-cc414fd8-9da4-409f-9d3a-3616d5898a91-55d014a9-2885-4a42-84af-0ce2ccbff9c9" by "_create_volume_from_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created reservations ['1700ee29-5cdb-47ed-92fb-6cc49bf83f32', '8e7b095e-a364-443c-9d50-e1461009bf9e', '6c5d97e2-d7b5-400b-9eb8-bcb63e063a73', '2696f8ba-4794-4e01-a9e3-934e302283b2'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-cc414fd8-9da4-409f-9d3a-3616d5898a91-55d014a9-2885-4a42-84af-0ce2ccbff9c9" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Creating volume 55d014a9-2885-4a42-84af-0ce2ccbff9c9 from snapshot cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:28 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Selected 10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862 as target Quobyte volume. {{(pid=83041) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-quobyte-55d014a9-2885-4a42-84af-0ce2ccbff9c9" by "_copy_volume_from_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-55d014a9-2885-4a42-84af-0ce2ccbff9c9" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] snapshot: cc414fd8-9da4-409f-9d3a-3616d5898a91, volume: 55d014a9-2885-4a42-84af-0ce2ccbff9c9, {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b442d52-2ef7-4415-8f0b-3b8e5e2174e5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.351s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:29 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Deleted volume successfully. Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-d24b92aa-0dcc-45dd-8922-25ff6926b494-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2feaf8c6-10ce-4a52-b03a-706cdca8834b tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-9a2b855e-310d-413a-b061-e80cdba6f03b-delete_volume" released by "delete_volume" :: held 4.100s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:29 devstack quobyte-client[83066]: System call of process 99134 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:29 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-d24b92aa-0dcc-45dd-8922-25ff6926b494-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91" returned: 0 in 0.765s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] will copy from snapshot at /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Creating direct copy from snapshot {{(pid=83041) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[85446f9b-3b4f-498b-9ba1-3f387c987737]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:30 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-quobyte-d24b92aa-0dcc-45dd-8922-25ff6926b494" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-d24b92aa-0dcc-45dd-8922-25ff6926b494" acquired by "delete_volume" :: waited 0.242s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb6d0b7-9261-433e-b06f-9ce165f9734c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d24b92aa-0dcc-45dd-8922-25ff6926b494 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" returned: 0 in 0.621s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG cinder.utils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9 not found in is_blk_device check {{(pid=83041) is_blk_device /opt/stack/cinder/cinder/utils.py:591}} Sep 16 02:02:30 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:31 devstack quobyte-client[83066]: System call of process 99142 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:31 devstack quobyte-client[83066]: The server volume:1c20c07b-de8c-44e1-a98c-8b6cfb21abdd@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1c20c07b-de8c-44e1-a98c-8b6cfb21abdd, inode=173, name=volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.67), requestorAccessMask=0 Sep 16 02:02:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d24b92aa-0dcc-45dd-8922-25ff6926b494" returned: 0 in 0.718s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d24b92aa-0dcc-45dd-8922-25ff6926b494 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:31 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d24b92aa-0dcc-45dd-8922-25ff6926b494" returned: 0 in 0.171s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:31 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-d24b92aa-0dcc-45dd-8922-25ff6926b494" released by "delete_volume" :: held 1.221s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:32 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created reservations ['4e38f6cd-9bbf-42e4-9f09-31cc31213e1c', '5aa90214-be2a-48c1-ad91-98cc071883fa', 'dce8dc48-b4b9-4eae-b783-1fe44c120303', '57302b8a-4591-4cf6-bf90-d9fb5a7121f1'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.032s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:33 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:33 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.319s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:33 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-9c19588b-8ae0-4806-8019-1623b6c1b1d8-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:34 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Deleted volume successfully. Sep 16 02:02:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-9c19588b-8ae0-4806-8019-1623b6c1b1d8-delete_volume" acquired by "delete_volume" :: waited 0.729s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:34 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-2b6908c2-ca3f-4feb-b247-0321c2a10696 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-d24b92aa-0dcc-45dd-8922-25ff6926b494-delete_volume" released by "delete_volume" :: held 5.005s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:35 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-quobyte-9c19588b-8ae0-4806-8019-1623b6c1b1d8" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:35 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-9c19588b-8ae0-4806-8019-1623b6c1b1d8" acquired by "delete_volume" :: waited 0.034s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:35 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[15501078-a63a-4aea-a0e9-a8b2e49c3fee]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:35 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9" returned: 0 in 5.593s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:36 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2283d4-3889-4756-9feb-8ec9de7d9d4a]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8" returned: 0 in 1.074s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:36 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-9c19588b-8ae0-4806-8019-1623b6c1b1d8" returned: 0 in 0.101s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:36 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-9c19588b-8ae0-4806-8019-1623b6c1b1d8" released by "delete_volume" :: held 1.399s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" returned: 0 in 0.721s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.image.image_utils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Image conversion details: src /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9 {{(pid=83041) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}} Sep 16 02:02:37 devstack cinder-volume[83041]: INFO cinder.image.image_utils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Converted 1024.00 MB image at 181.81 MB/s Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] File path /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9 is being set with permissions: 660 {{(pid=83041) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created reservations ['742b8046-7e74-4e85-82c3-423a1da8898d', '9734872e-8a1d-49ae-a4e8-d852c7a84562', '3b682cc6-0227-4c07-b15e-390e826ace53', '597684f1-06c5-40fe-bae2-079887b00a3c'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9" returned: 0 in 0.236s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-55d014a9-2885-4a42-84af-0ce2ccbff9c9" released by "_copy_volume_from_snapshot" :: held 8.563s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-cc414fd8-9da4-409f-9d3a-3616d5898a91-55d014a9-2885-4a42-84af-0ce2ccbff9c9" released by "_create_volume_from_snapshot" :: held 8.617s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.656s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (664d9ce4-a187-4d60-8c91-4db2dcde153f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9', 'volume_size': 1, 'snapshot_id': 'cc414fd8-9da4-409f-9d3a-3616d5898a91'}' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdca0353-23a1-4721-8bc6-2229a50e5978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Sep 16 02:02:37 devstack cinder-volume[83041]: INFO cinder.volume.flows.manager.create_volume [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Volume volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9 (55d014a9-2885-4a42-84af-0ce2ccbff9c9): created successfully Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdca0353-23a1-4721-8bc6-2229a50e5978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=83041) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Flow 'volume_create_manager' (acee8f83-2044-4a68-bcf1-031b3af999c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=83041) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:37 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.264s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-405c3000-93a3-42ea-8491-9c38a95d6c1c tempest-SnapshotDependencyTests-1853226544 None] Created volume successfully. Sep 16 02:02:38 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Deleted volume successfully. Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-08c103e3-eef4-4e1d-9f62-69d4586d49e3 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-9c19588b-8ae0-4806-8019-1623b6c1b1d8-delete_volume" released by "delete_volume" :: held 3.489s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-ee749809-e319-456b-bbd5-912320597cbc-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-ee749809-e319-456b-bbd5-912320597cbc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-cc414fd8-9da4-409f-9d3a-3616d5898a91-delete_snapshot" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-cc414fd8-9da4-409f-9d3a-3616d5898a91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:38 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-quobyte-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" by "delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" acquired by "delete_snapshot" :: waited 0.059s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-quobyte-cc414fd8-9da4-409f-9d3a-3616d5898a91" by "_delete_snapshot" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:38 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-quobyte-ee749809-e319-456b-bbd5-912320597cbc" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-cc414fd8-9da4-409f-9d3a-3616d5898a91" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Deleting offline snapshot cc414fd8-9da4-409f-9d3a-3616d5898a91 of volume c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] snapshot_file for this snap is: volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-ee749809-e319-456b-bbd5-912320597cbc" acquired by "delete_volume" :: waited 0.035s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[163cd909-6dfa-434e-a7d8-bbab7e2371f5]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72858ac-1a8e-448b-9baa-d1415bbef472]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:38 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ee749809-e319-456b-bbd5-912320597cbc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91" returned: 0 in 0.487s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.remotefs [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=83041) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e8b46e-0237-4256-9ae1-ee08da0c5382]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ee749809-e319-456b-bbd5-912320597cbc" returned: 0 in 0.622s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ee749809-e319-456b-bbd5-912320597cbc {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-ee749809-e319-456b-bbd5-912320597cbc" returned: 0 in 0.121s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:39 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-ee749809-e319-456b-bbd5-912320597cbc" released by "delete_volume" :: held 0.982s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" returned: 0 in 0.601s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91" returned: 0 in 0.343s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:40 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96.cc414fd8-9da4-409f-9d3a-3616d5898a91" returned: 0 in 0.200s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:40 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created reservations ['2d873ed1-a8d2-4ab0-94e8-9995e4005d17', '1727add6-6158-4d0f-828e-e836a5708a3f', '0653e166-4288-4683-9c6a-00735d7bae8c', '70cc27fb-cb3e-46a0-b733-414ed48af4b7'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-cc414fd8-9da4-409f-9d3a-3616d5898a91" released by "_delete_snapshot" :: held 1.978s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:40 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" released by "delete_snapshot" :: held 2.020s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Created reservations ['a997b518-1d20-4c56-9bfa-22a0b1bc7412', 'd39d958d-3645-4e52-9127-659ac15c0255', '41f1ae38-fd4d-4b97-9549-ae713fd502c9', 'f270f07a-7621-46ae-b23d-413850d43b31'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.290s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:41 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Deleted volume successfully. Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-cf0bd124-0a88-47f3-938c-33e71a90ae0c tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-ee749809-e319-456b-bbd5-912320597cbc-delete_volume" released by "delete_volume" :: held 2.808s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:41 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Delete snapshot completed successfully. Sep 16 02:02:41 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-c38154b5-c90c-4cac-afb0-e952a44445a7 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-cc414fd8-9da4-409f-9d3a-3616d5898a91-delete_snapshot" released by "delete_snapshot" :: held 2.844s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-d283c168-13b0-40ce-966d-0a4ea8287b4c-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-d283c168-13b0-40ce-966d-0a4ea8287b4c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "cinder-quobyte-d283c168-13b0-40ce-966d-0a4ea8287b4c" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:42 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-quobyte-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-d283c168-13b0-40ce-966d-0a4ea8287b4c" acquired by "delete_volume" :: waited 0.016s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" acquired by "delete_volume" :: waited 0.026s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07dfd77-f6a9-42ae-9010-e47eabec278e]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[254d0f24-e812-4b15-bc6e-a263d559a0d6]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d283c168-13b0-40ce-966d-0a4ea8287b4c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d283c168-13b0-40ce-966d-0a4ea8287b4c" returned: 0 in 0.476s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d283c168-13b0-40ce-966d-0a4ea8287b4c {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:42 devstack quobyte-client[83066]: System call of process 99189 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application. Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" returned: 0 in 0.588s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:42 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-d283c168-13b0-40ce-966d-0a4ea8287b4c" returned: 0 in 0.218s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-quobyte-d283c168-13b0-40ce-966d-0a4ea8287b4c" released by "delete_volume" :: held 0.881s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" returned: 0 in 0.344s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96" released by "delete_volume" :: held 1.093s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Created reservations ['2048a7cd-6d41-4c79-88db-62126c926b56', 'e422ba4e-1b62-4dd8-9371-a943c199d54e', 'c50e4a91-c884-4a7a-874f-a174c5bc14f9', 'b9d13add-e209-49d3-8b21-aaa062ac9813'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Created reservations ['ea134995-21e2-4476-8dc8-7fd7eeebc18e', '450cf747-ba8b-436e-86ae-faddf7423f83', '082e8bef-cefe-4b52-86b4-341b9d521b33', '7ba1f09f-22b0-4520-b3fb-cc6dda6565ee'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.165s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:43 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:43 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Deleted volume successfully. Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-819dde9b-0165-427f-97cc-2c48d24dfc80 tempest-CreateVolumesFromSourceVolumeTest-789072571 None] Lock "cinder-d283c168-13b0-40ce-966d-0a4ea8287b4c-delete_volume" released by "delete_volume" :: held 1.961s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.161s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:44 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Deleted volume successfully. Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-55d014a9-2885-4a42-84af-0ce2ccbff9c9-delete_volume" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4878d332-d5c3-452e-87ee-5aba9dc530a6 tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-c4d26ef9-72e4-4bf8-8b85-1fd28e5bae96-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-55d014a9-2885-4a42-84af-0ce2ccbff9c9-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:44 devstack cinder-volume[83041]: WARNING cinder.volume.volume_utils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack. Use at your own risk. Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "cinder-quobyte-55d014a9-2885-4a42-84af-0ce2ccbff9c9" by "delete_volume" {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:143}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-55d014a9-2885-4a42-84af-0ce2ccbff9c9" acquired by "delete_volume" :: waited 0.013s {{(pid=83041) __acquire /opt/stack/cinder/cinder/coordination.py:146}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG oslo.privsep.daemon [-] privsep: reply[2206b843-53c1-4fb0-befe-f1bbb2417e1c]: (4, 'qcow2') {{(pid=84046) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}} Sep 16 02:02:44 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9" returned: 0 in 0.431s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9 {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] CMD "rm -f /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a/volume-55d014a9-2885-4a42-84af-0ce2ccbff9c9" returned: 0 in 0.103s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-quobyte-55d014a9-2885-4a42-84af-0ce2ccbff9c9" released by "delete_volume" :: held 0.730s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG cinder.quota [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Created reservations ['6fa14866-8987-480e-b089-d9101e918b10', '7d584efe-c10a-4c45-9579-6926620362c4', '5de009e7-4cc9-4767-990f-54674978bb1d', 'f9496291-c600-4444-b07d-226392bf1362'] {{(pid=83041) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:02:45 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:02:46 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.143s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:02:46 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Sep 16 02:02:46 devstack cinder-volume[83041]: INFO cinder.volume.manager [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Deleted volume successfully. Sep 16 02:02:46 devstack cinder-volume[83041]: DEBUG cinder.coordination [None req-4f3494e8-f250-4b3c-add2-1811ca99382d tempest-SnapshotDependencyTests-1853226544 None] Lock "cinder-55d014a9-2885-4a42-84af-0ce2ccbff9c9-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=83041) __release /opt/stack/cinder/cinder/coordination.py:157}} Sep 16 02:02:55 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:SELECT=62,cinder:UPDATE=97,cinder:DELETE=10,cinder:INSERT=22 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 02:02:56 devstack cinder-volume[83041]: DEBUG dbcounter [-] [83041] Writing DB stats cinder:INSERT=27,cinder:UPDATE=99,cinder:SELECT=69,cinder:DELETE=9 {{(pid=83041) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG oslo_service.periodic_task [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=83041) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862': None} {{(pid=83041) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG cinder.volume.drivers.quobyte [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Available shares ['10.10.41.181/cinder-vol-d9667851-018b-45ac-b88f-53a4a64d9862'] {{(pid=83041) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.lockutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=83041) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG oslo_concurrency.processutils [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/85a2a32ee4dd0f629879423c5676b73a" returned: 0 in 0.094s {{(pid=83041) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}} Sep 16 02:03:05 devstack cinder-volume[83041]: DEBUG cinder.manager [None req-c381b242-cef0-455f-af3e-4571f06ce5d0 None None] Notifying Schedulers of capabilities ... {{(pid=83041) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}